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(54) VIDEO SIGNAL ENCODING METHOD, VIDEO SIGNAL ENCODER, AND PROGRAM 
RECORDED MEDIUM 



(57) When a digital video signal is compressed by a 
given method and the compressed signal is trans- 
formed to a video signal of another compression 
method, the code amount of the transformed video sig- 
nal sometimes exceeds the capacity of a transmission 
channel. Therefore, an input digital video signal is dis- 
crete cosine transformed. A quantizer is selected which 
enables both code amounts that are obtained by apply- 
ing first and second variable length codings on AC com- 
ponents of the discrete cosine transformed digital video 
signal, to be equal to or smaller than a differential code 
amount that is obtained by subtracting, from a predeter- 
mined code amount, a maximum additional information 
amount which is a larger one of information amounts of 
first and second additional information, and a maximum 
DC code amount which is a larger one of a predictive 
code amount which is obtained by performing difference 
predictive coding on DC components of the discrete 
cosine transformed input digital video signal, and a fixed 
code amount in the case where the DC components are 
set to a fixed length. The AC components of the discrete 
cosine transformed digital video signal are quantized by 
the selected quantizer, and DC components and the 
first additional information are added to produce a first 
bit stream. 
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Description 

Technical Field 

s [0001] The present invention relates to a video signal coding method which codes a video signal, a video signal 
coding apparatus, and a program recording medium. 

Background Art 

10 [0002] Recently, digitization of the environment of a video signal is rapidly advancing. For example, apparatuses for 
handling a digital video signal come into widespread use, and a digital broadcast is to be started. However, digitization 
of a digital video signal involves compression of the video signal, and hence there arise a problem due to a mixture of 
plural compression systems, and another problem in that the image quality is lowered as a result of compression of the 
video signal. 

75 [0003] First, the problem due to a mixture of plural compression systems will be described. For example, a case will 
be considered in which a video signal is recorded on a VTR by using DVCPRO compression, and the recorded video 
signal on the VTR is transmitted by using MPEG2 compression. The two compression systems are different from each 
other in detail portion of compression. In order to transform a DVCPRO compressed bit stream to a MPEG2 bit stream, 
therefore, it is necessary that the DVCPRO compressed bit stream is once expanded and the decoded bit stream is 

20 then applied MPEG2 compression. As a result, the video signal is twice compressed, so that the image quality is low- 
ered in the transmission. 

[0004] In order to prevent such image quality degradation from occurring, a compression system has been studied 
in which a DVCPRO compressed bit stream can be transformed to a MPEG2 bit stream by bit stream transformation 
only When this compression system is realized, the above-mentioned image quality degradation can be prevented from 

25 occurring. However, the two systems are different from each other in compression method of VLC code and DC, Syn- 
tax, and the like, and hence the total code amount of transformed bit streams may be sometimes increased. As a result, 
there arises a problem in that the upper limit of the total code amount of transformed bit streams cannot be guaranteed. 
[0005] On the other hand, image quality degradation due to compression of a video signal will be described. In gen- 
eral, an image quality is affected by the bit rate and the definition of an image. The definition of an image indicates the 

30 statistical property of the image. In an image of a fine pattern or complex motion, and an image of a high noise level, 
the definition is high. In order to improve the image quality while maintaining the bit rate constant, a method is well 
known in which band limitation is performed by a filter to make the definition of an image smaller. The band limitation 
by a filter is performed on an input image, or on a motion-compensated difference image. 

[0006] In the band limitation which is performed on an input image by a filter, a filter process is always conducted 
35 irrespective of the picture type of the input image. Therefore, there is a problem in that, with respect to a still image of 
a very high frame definition, for example, an image which is obtained by processing the image results in an obscure 
image which has applied band limitation, although the code amount is sufficiently large. The band limitation which is 
performed on a motion-compensated difference image by a filter is controlled only on the basis of the definition of the 
difference image. Consequently, there is a problem in that it is impossible to correctly decide whether a region is an 
40 edge region which is visually important or a highly random region which is not visually important. 

Disclosure of Invention 

[0007] It is an object of the invention to provide a video signal coding method which codes a bit stream before trans- 
45 formation so that the code amount of the transformed bit stream can be set within a predetermined code amount, and 
also an apparatus for the same. 

[0008] It is an object of the invention to provide a video signal coding apparatus in which a band limiting filter is 
adaptively used, thereby improving the image quality. 

[0009] A first invention of the present invention (corresponding to claim 1) is a video signal coding method in which 
so an input digital video signal is coded by using discrete cosine transform, quantization, and variable length coding, char- 
acterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables N kinds (N £ 2) of code 
amounts to be equal to or smaller than a predetermined code amount, the code amounts being obtained by apply- 
55 ing N kinds of variable length codings on the discrete cosine transformed input digital video signal. 

[0010] According to the method, quantization can be performed while selecting a quantizer which, even when any 
one of the systems is used, enables the code amount of AC components that are dominant with respect to the code 
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amount in a bit stream, to become a specified code amount, and the objects can be attained. 

[0011] A second invention of the present invention (corresponding to claim 2) is a video signal coding apparatus 

characterized in that said apparatus comprises: 

5 orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be equal 
to or smaller than a predetermined code amount, the code amounts being obtained by applying quantization and 
N kinds of variable length codings on the transformed signal; 
10 quantizing means for quantizing the transformed signal to produce a quantized signal, by using said quantizer 
which is selected by said quantization estimating means; and 

variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

75 [001 2] According to this conf iguration, quantization can be performed while selecting a quantizer which, even when 
any one of the systems is used, enables the code amount of AC components that are dominant with respect to the code 
amount in a bit stream, to become a specified code amount, and the objects can be attained. 
[0013] A third invention of the present invention (corresponding to claim 3) is a video signal coding apparatus 
according to the 2nd invention of the present invention, characterized in that the input digital video signal is a video sig- 

20 nal which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

[0014] A fourth invention of the present invention (corresponding to claim 4) is a video signal coding method in 
25 which an input digital video signal is coded by using discrete cosine transform, quantization, and first variable length 
coding, to produce a first bit stream that can be transformed to a second bit stream by using decoding of the first vari- 
able length coding, difference predictive coding, and second variable length coding, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
30 obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
formed input digital video signal, to be equal to or smaller than a differential code amount that is obtained by sub- 
tracting, from a predetermined code amount, a maximum DC code amount which is a larger one among a 
predictive code amount which is obtained by performing difference predictive coding on DC components of the dis- 
crete cosine transformed input digital video signal, and a fixed code amount in the case where the DC components 
35 are set to a fixed length. 

[001 5] A fifth invention of the present invention (corresponding to claim 5) is a video signal coding method in which 
an input digital video signal is coded by using discrete cosine transform, difference predictive coding, quantization, and 
first variable length coding, to produce a first bit stream that can be transformed to a second bit stream by using decod- 
40 ing of the first variable length coding, decoding of the difference predictive coding, and second variable length coding, 
characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
45 formed input digital video signal, to be equal to or smaller than a differential code amount that is obtained by sub- 
tracting, from a predetermined code amount, a maximum DC code amount which is a larger one among a 
predictive code amount which is obtained by performing difference predictive coding on DC components of the dis- 
crete cosine transformed input digital video signal, and a fixed code amount in the case where the DC components 
are set to a fixed length. 

50 

[001 6] A sixth invention of the present invention (corresponding to claim 6) is a video signal coding apparatus char- 
acterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
55 a transformed signal ; 

code amount estimating means for setting a larger one among a difference predictive code amount which is 
obtained by performing difference predictive coding on DC components of the discrete cosine transformed input 
digital video signal, and a fixed code amount in the case where the DC components are set to a fixed length, as a 
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DC estimated code amount; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be equal 
to or smaller than a differential code amount which is obtained by subtracting the DC estimated code amount from 
a predetermined code amount, the code amounts being obtained by applying quantization and N kinds of variable 
5 length codings on AC components of the transformed signal; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, by 
using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

10 

[0017] A seventh invention of the present invention (corresponding to claim 7) is a video signal coding apparatus 
characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
is a transformed signal; 

predictive differential coding means for performing predictive differential coding on DC components of the discrete 
cosine transformed input digital video signal, and setting a code amount produced in the predictive differential cod- 
ing, as a difference predictive code amount; 

code amount estimating means for setting a larger one among the difference predictive code amount, and a fixed 
20 code amount in the case where the DC components are set to a fixed length, as a DC estimated code amount; 

quantization estimating means for selecting a quantizer which enables N kinds (N z 2) of code amounts to be equal 
to or smaller than a differential code amount which is obtained by subtracting the DC estimated code amount from 
a predetermined code amount, the code amounts being obtained by applying quantization and N kinds of variable 
length codings on AC components of the transformed signal; 
25 quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, by 
using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

30 [0018] A eighth invention of the present invention (corresponding to claim 8) is a video signal coding apparatus 
characterized in that said apparatus comprises: 

code amount estimating means for, for each of predetermined blocks of an input digital video signal, obtaining an 
average value of pixels in the block, setting the average value as a value of DC components which are obtained by 

35 performing discrete cosine transform on the digital video signal, and setting a larger one among a difference pre- 
dictive code amount which is obtained by performing difference predictive coding on the DC components, and a 
fixed code amount in the case where the DC components are set to a fixed length, as a DC estimated code amount; 
orthogonal transforming means for performing discrete cosine transform on the digital video signal for each of the 
blocks to produce a transform coding unit; 

40 quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be equal 
to or smaller than a differential code amount which is obtained by subtracting the DC estimated code amount from 
a predetermined code amount, the code amounts being obtained by applying quantization and N kinds of variable 
length codings on AC components of the transformed signal; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, by 
45 using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

[0019] A ninth invention of the present invention (corresponding to claim 9) is a video signal coding apparatus 
so according to any one of the 6th to 8th inventions, characterized in that the input digital video signal is a video signal 
which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

55 [0020] A tenth invention of the present invention (corresponding to claim 10) is a video signal coding apparatus 
according to the 9th invention, characterized in that the difference predictive code amount of the DC components is a 
difference between a predetermined code amount, and an average value of pixels of a block in the coding unit within 
the DC estimated code amount. 
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[0021] An eleventh invention of the present invention (corresponding to claim 11) is a video signal coding method 
inwhich an input digital video signal is coded by using discrete cosine transform, quantization, and first variable length 
coding, and first additional information is added to produce a first bit stream that can be transformed to a second bit 
stream by using decoding of the first variable length coding, and second variable length coding, and adding second 
5 additional information, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
formed digital video signal, to be equal to or smaller than a differential code amount that is obtained by subtracting, 
io from a predetermined code amount, a maximum additional information amount which is a larger one among infor- 
mation amounts of the first and second additional information. 

[0022] A twelfth invention of the present invention (corresponding to claim 12) is a video signal coding apparatus 
characterized in that said apparatus comprises: 

75 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

additional information estimating means for detecting a maximum additional information amount which is a larger 
one among a code amount of first additional information that is to be attached to a first bit stream which is obtained 
20 by applying first variable length coding on the transformed signal, and a code amount of second additional informa- 
tion that is to be attached to a second bit stream which is obtained by applying second variable length coding on 
the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on the transformed signal, and a code amount that is 
25 obtained by applying quantization and the second variable length coding on the transformed signal, to be equal to 
or smaller than a differential code amount that is obtained by subtracting the maximum additional information 
amount from a predetermined code amount; 

quantizing means for quantizing the transformed signal to produce a quantized signal, by using said quantizer 
which is selected by said quantization estimating means; and 
30 variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0023] A thirteenth invention of the present invention (corresponding to claim 1 3) is a video signal coding apparatus 
according to the 12th invention, characterized in that the input digital video signal is a video signal which is previously 
divided into predetermined coding units, and 

35 

said quantization estimating means selects a quantizer for each of the coding units. 

[0024] A fourteenth invention of the present invention (corresponding to claim 1 4) is a video signal coding appara- 
tus according to the 13th invention, characterized in that the differential code amount is a difference between an aver- 

40 age additional information amount which is obtained by dividing the maximum additional information amount by a 
number of the coding units in the input digital video signal, and the predetermined code amount. 
[0025] A fifteenth invention of the present invention (corresponding to claim 1 5) is a video signal coding method in 
which an input digital video signal is coded by using discrete cosine transform, quantization, and first variable length 
coding, and first additional information is added to produce a first bit stream that can be transformed to a second bit 

45 stream by using decoding of the first variable length coding, and second variable length coding, and adding the first 
additional information with changing to second additional information, characterized in that 

in the quantization, quantization is performed white selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 

so formed digital video signal, to be equal to or smaller than a differential code amount that is obtained by subtracting, 
from a predetermined code amount, a maximum additional information amount which is a larger one of information 
amounts of the first and second additional information, and a maximum DC code amount which is a larger one of 
a predictive code amount which is obtained by performing difference predictive coding on DC components of the 
discrete cosine transformed input digital video signal, and a fixed code amount in the case where the DC compo- 

55 nents are set to a fixed length. 

[0026] A sixteenth invention of the present invention (corresponding to claim 1 6) is a video signal coding method in 
which an input digital video signal is coded by using discrete cosine transform, difference predictive coding, quantiza- 
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tion, and first variable length coding, and first additional information is added to produce a first bit stream that can be 
transformed to a second bit stream by using decoding of the first variable length coding, decoding of the difference pre- 
dictive coding, and second variable length coding, and adding the first additional information with changing to second 
additional information, characterized in that 

5 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
formed digital video signal, to be equal to or smaller than a differential code amount that is obtained by subtracting, 
from a predetermined code amount, a maximum additional information amount which is a larger one of information 
io amounts of the first and second additional information, and a maximum DC code amount which is a larger one 
among a predictive code amount which is obtained by performing difference predictive coding on DC components 
of the discrete cosine transformed input digital video signal, and a fixed code amount in the case where the DC 
components are set to a fixed length. 

is [0027] A seventeenth invention of the present invention (corresponding to claim 1 7) is a video signal coding appa- 
ratus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

20 code amount estimating means for setting a larger one of a difference predictive code amount which is obtained by 
performing difference predictive coding on DC components of the discrete cosine transformed input digital video 
signal, and a fixed code amount in the case where the DC components are set to a fixed length, as a DC estimated 
code amount; 

additional information estimating means for detecting a maximum additional information amount which is a larger 
25 one among a code amount of first additional information that is to be attached to a first bit stream which is obtained 
by applying first variable length coding on the transformed signal, and a code amount of second additional informa- 
tion that is to be attached to a second bit stream which is obtained by applying second variable length coding on 
the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
30 applying quantization and the first variable length coding on AC components of the transformed signal, and a code 
amount that is obtained by applying quantization and the second variable length coding on the AC components of 
the transformed signal, to be equal to or smaller than a differential code amount that is obtained by subtracting the 
DC estimated code amount and the maximum additional information amount from a predetermined code amount; 
quantizing means for quantizing AC components of the transformed signal to produce a quantized signal, by using 
35 said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0028] An eighteenth invention of the present invention (corresponding to claim 18) is a video signal coding appa- 
ratus characterized in that said apparatus comprises: 

40 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

predictive coding means for performing difference predictive coding on DC components of the discrete cosine 
transformed input digital video signal, and obtaining a difference predictive code amount; 

45 code amount estimating means for setting a larger one of the difference predictive code amount, and a fixed code 
amount in the case where the DC components are set to a fixed length, as a DC estimated code amount; 
additional information estimating means for detecting a maximum additional information amount which is a larger 
one of a code amount of first additional information that is to be attached to a first bit stream which is obtained by 
applying first variable length coding on the transformed signal, and a code amount of second additional information 

so that is to be attached to a second bit stream which is obtained by applying second variable length coding on the 
transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a code 
amount that is obtained by applying quantization and the second variable length coding on the AC components of 
55 the transformed signal, to be equal to or smaller than a differential code amount that is obtained by subtracting DC 
estimated code amount and the maximum additional information amount from a predetermined code amount; 
quantizing means for quantizing AC components of the transformed signal to produce a quantized signal, by using 
said quantizer which is selected by said quantization estimating means; and 
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variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0029] A nineteenth invention of the present invention (corresponding to claim 19) is a video signal coding appara- 
tus characterized in that said apparatus comprises: 

5 

code amount estimating means for, for each of predetermined blocks of an input digital video signal, obtaining an 
average value of pixels in the block, setting the average value as a value of DC components which are obtained by 
performing discrete cosine transform on the digital video signal, and setting a larger one of a difference predictive 
code amount which is obtained by performing difference predictive coding on the DC components, and a fixed code 
10 amount in the case where the DC components are set to a fixed length, as a DC estimated code amount; 

orthogonal transforming means for performing discrete cosine transform on the digital video signal for each of the 
blocks to produce a transform coding unit; 

additional information estimating means for detecting a maximum additional information amount which is a larger 
one among a code amount of first additional information that is to be attached to a first bit stream which is obtained 
is by applying first variable length coding on the transform coding unit, and a code amount of second additional infor- 
mation that is to be attached to a second bit stream which is obtained by applying second variable length coding 
on the transform coding unit; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transform coding unit, and a 
20 code amount that is obtained by applying quantization and the second variable length coding on the AC compo- 
nents of the transform coding unit, to be equal to or smaller than a differential code amount that is obtained by sub- 
tracting the DC estimated code amount and the maximum additional information amount from a predetermined 
code amount; 

quantizing means for quantizing the AC components of the transform coding unit to produce a quantized signal, by 
25 using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0030] A twentieth invention of the present invention (corresponding to claim 20) is a video signal coding apparatus 
according to any one of the 17th to 19th inventions, characterized in that the input digital video signal is a video signal 
30 which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

[0031 ] The twenty-first invention of the present invention (corresponding to claim 2 1 ) is a video signal coding appa- 
35 ratus according to the 20th invention, characterized in that the difference predictive code amount of the DC components 
is a difference obtained by subtracting, from the predetermined code amount, the DC estimated code amount for a 
block in the coding units, and an average additional information amount which is obtained by dividing the maximum 
additional information amount by a number of the coding units in the input digital video signal. 
[0032] A twenty-second invention of the present invention (corresponding to claim 22) is a video signal coding 
40 method in which an input digital video signal is coded by a first system that uses discrete cosine transform, quantization, 
and first variable length coding, to produce a first bit stream that can be transformed to a second bit stream which is 
coded by a second system by using decoding of the first variable length coding, difference predictive coding, and sec- 
ond variable length coding, characterized in that 

45 when a quantizer for the quantization is to be selected, 

a second system code amount in the case where the difference predictive coding and the second variable length 
coding are performed on a digital video signal which is discrete cosine transformed and quantized previously in 
time to a discrete cosine transformed input digital video signal which is the object of the quantization 
is compared with a preset ideal code amount of the second system, and 

so when the second system code amount is equal to or smaller than the ideal code amount, a quantizer which per- 
forms coding at a first target code amount that is previously determined in the first system is selected, and 
when the second system code amount is larger than the ideal code amount, a quantizer which performs coding at 
a code amount that is smaller than the first target code amount is selected. 

55 [0033] A twenty-third invention of the present invention (corresponding to claim 23) is a video signal coding method 
in which an input digital video signal is coded by using discrete cosine transform, difference predictive coding, quanti- 
zation, and first variable length coding to produce a first bit stream that can be transformed to a second bit stream by 
using decoding of the first variable length coding, decoding of the difference predictive coding, and second variable 
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length coding, characterized in that 

when a quantizer for the quantization is to be selected. 

a second system code amount in the case where the difference predictive coding and the second variable length 
5 coding are performed on a digital video signal which is discrete cosine transformed, difference predictive coded, 
and quantized previously in time to a discrete cosine transformed input digital video signal which is the object of the 
quantization 

is compared with a preset ideal code amount of the second system, and 

when the second system code amount is equal to or smaller than the ideal code amount, a quantizer which per- 
10 forms coding at a first target code amount that is previously determined in the first system is selected, and 

when the second system code amount is larger than the ideal code amount, a quantizer which performs coding at 
a code amount that is smaller than the first target code amount is selected. 

[0034] A twenty-fourth invention of the present invention (corresponding to claim 24) is a video signal coding 
75 method according to the 22nd or 23rd invention, characterized in that the ideal code amount is stepwise increased by 
a substantially constant value with the passage of time. 

[0035] A twenty-fifth invention of the present invention (corresponding to claim 25) is a video signal coding method 
according to any one of the 22nd to 24th inventions, characterized in that, when the second system code amount is 
larger than the ideal code amount, a quantizer which performs coding at a code amount that is obtained by subtracting 
20 a difference between the second system code amount and the ideal code amount from the first target code amount is 
selected. 

[0036] A twenty-sixth invention of the present invention (corresponding to claim 26) is a video signal coding method 
according to any one of the 22nd to 25th inventions, characterized in that the digital video signal which is discrete cosine 
transformed, and quantized previously in time means a predetermined partial signal which is previous to the discrete 

25 cosine transformed input digital video signal which is the object of the quantization. 

[0037] A twenty-seventh invention of the present invention (corresponding to claim 27) is a video signal coding 
apparatus in which an input digital video signal is coded by a first system that uses discrete cosine transform, quanti- 
zation, and first variable length coding, to produce a first bit stream that can be transformed to a second bit stream 
which is coded by a second system by using decoding of the first variable length coding, difference predictive coding, 

30 and second variable length coding, characterized in that 

said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on the input digital video signal to produce 
a transformed signal; 

35 quantizing means for quantizing the transformed signal to produce a quantized signal; 

DC component code amount estimating means for estimating a difference predictive code amount in the case 
where the difference predictive coding is performed on DC components of a digital video signal which is discrete 
cosine transformed and quantized previously in time to the transformed signal which is the object of the quantiza- 
tion in said quantizing means; 

40 second-system code amount estimating means for estimating a second system code amount which is a total of the 
difference predictive code amount, and a code amount in the case where the second variable length coding is per- 
formed on AC components of the digital video signal which is discrete cosine transformed and quantized previously 
in time; 

quantization estimating means for comparing the second system code amount with a preset ideal code amount of 
45 the second system, and, when the second system code amount is equal to or smaller than the ideal code amount, 
selecting a quantizer which performs coding at a first target code amount that is previously determined in the first 
system, and, when the second system code amount is larger than the ideal code amount, selecting a quantizer 
which performs coding at a code amount that is smaller than the first target code amount; and 
variable length coding means for applying the first variable length coding on the quantized signal, and wherein 
so said quantizing means quantizes AC components of the transformed signal which is an object of the quantization, 
by using said quantizer which is selected by said quantization estimating means, thereby producing the quantized 
signal. 

[0038] A twenty-eighth invention of the present invention (corresponding to claim 28) is a video signal coding appa- 
55 ratus in which an input digital video signal is coded by using discrete cosine transform, difference predictive coding, 
quantization, and first variable length coding to produce a first bit stream that can be transformed to a second bit stream 
by using decoding of the first variable length coding, decoding of the difference predictive coding, and second variable 
length coding, characterized in that 
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said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on the input digital video signal to produce 
a transformed signal; 

quantizing means for quantizing the transformed signal to produce a quantized signal; 
5 DC component code amount estimating means for estimating a DC code amount in the case where the difference 
predictive coding is performed on DC components of a digital video signal which is discrete cosine transformed, 
difference predictive coded, and quantized previously in time to the transformed signal which is the object of the 
quantization in said quantizing means; 

second-system code amount estimating means for estimating a second system code amount which is a total of the 
w DC code amount, and a code amount in the case where the second variable length coding is performed on AC 
components of the digital video signal which is discrete cosine transformed, difference predictive coded, and quan- 
tized previously in time; 

quantization estimating means for comparing the second system code amount with a preset ideal code amount of 
the second system, and, when the second system code amount is equal to or smaller than the ideal code amount, 

75 selecting a quantizer which performs coding at a first target code amount that is previously determined in the first 
system, and, when the second system code amount is larger than the ideal code amount, selecting a quantizer 
which performs coding at a code amount that is smaller than the first target code amount; and 
variable length coding means for applying the first variable length coding on the quantized signal, and wherein 
said quantizing means quantizes AC components of the transformed signal which is an object of the quantization, 

20 by using said quantizer which is selected by said quantization estimating means, thereby producing the quantized 
signal. 

[0039] A twenty-ninth invention of the present invention (corresponding to claim 29) is a video signal coding appa- 
ratus according to the 27th or 28th invention, characterized in that the ideal code amount is stepwise increased by a 

25 substantially constant value with the passage of time. 

[0040] A thirtieth invention of the present invention (corresponding to claim 30) is a video signal coding apparatus 
according to any one of the 27th to 29th inventions, characterized in that, when the second system code amount is 
larger than the ideal code amount, said quantization estimating means selects a quantizer which performs coding at a 
code amount that is obtained by subtracting a difference between the second system code amount and the ideal code 

30 amount from the first target code amount. 

[0041] A thirty-first invention of the present invention (corresponding to claim 31) is a video signal coding apparatus 
according to any one of the 27th to 30th inventions, characterized in that the digital video signal which is discrete cosine 
transformed and quantized previously in time means a predetermined partial signal which is previous to the discrete 
cosine transformed input digital video signal which is the object of the quantization. 

35 [0042] A thirty-second invention of the present invention (corresponding to claim 32) is a video signal coding 
method in which an input digital video signal is coded by using discrete cosine transform, quantization, and first variable 
length coding, and first additional information is added to produce a first bit stream that can be transformed to a second 
bit stream by using decoding of the first variable length coding, difference predictive coding, and second variable length 
coding, and adding the first additional information with changing to second additional information, characterized in that 

40 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
formed digital video signal, to be equal to or smaller than a differential code amount that is obtained by subtracting, 
from a predetermined code amount, a larger one among a first total in which a fixed code amount in the case where 
45 DC components of the discrete cosine transformed input digital video signal are set to a fixed length is added to an 
information amount of the first additional information, and a second total in which a difference predictive code 
amount which is obtained by performing difference predictive coding on DC components of the discrete cosine 
transformed input digital video signal is added to an information amount of the second additional information. 

so [0043] A thirty-third invention of the present invention (corresponding to claim 33) is a video signal coding method 
in which an input digital video signal is coded by using discrete cosine transform, difference predictive coding, quanti- 
zation, and first variable length coding, and first additional information is added to produce a first bit stream that can be 
transformed to a second bit stream by using decoding of the first variable length coding, decoding of the difference pre- 
dictive coding, and second variable length coding, and adding the first additional information with changing to second 

55 additional information, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts that are 
obtained by applying the first and second variable length codings on AC components of the discrete cosine trans- 
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formed digital video signal, to be equal to or smaller than a differential code amount that is obtained by subtracting, 
from a predetermined code amount, a larger one among a first total in which a difference predictive code amount 
which is obtained by performing difference predictive coding on DC components of the discrete cosine transformed 
input digital video signal is added to an information amount of the first additional information, and a second total in 
5 which a fixed code amount in the case where DC components of the discrete cosine transformed input digital video 

signal are set to a fixed length is added to an information amount of the second additional information. 

[0044] A thirty-fourth of the present invention (corresponding to claim 34) is a video signal coding apparatus char- 
acterized in that said apparatus comprises: 

10 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

first detecting means for detecting a first total amount of a fixed code amount in the case where DC components of 
the transformed signal are set to a fixed length, and a code amount of first additional information that is to be 

is attached to a first bit stream which is obtained by applying first variable length coding on the transformed signal; 

second detecting means for detecting a second total amount of a difference predictive code amount which is 
obtained by performing difference predictive coding on the DC components of the transformed signal, and a code 
amount of second additional information that is to be attached to a second bit stream which is obtained by applying 
second variable length coding on the transformed signal; 

20 quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a code 
amount that is obtained by applying quantization and the second variable length coding on the AC components of 
the transformed signal, to be equal to or smaller than a differential code amount that is obtained by subtracting a 
larger one among the first total amount and the second total amount from a predetermined code amount; 

25 quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, by 
using said quantizer which is selected by said quantization estimating means; and 
variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0045] A thirty-fifth invention of the present invention (corresponding to claim 35) is a video signal coding apparatus 
30 characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to produce 
a transformed signal; 

predictive coding means for performing difference predictive coding on DC components of the discrete cosine 
35 transformed input digital video signal, and obtaining a difference predictive code amount; 

first detecting means for detecting a first total amount of the difference predictive code amount, and a code amount 
of first additional information that is to be attached to a first bit stream which is obtained by applying first variable 
length coding on the transformed signal; 

second detecting means for detecting a second total amount of a fixed code amount in the case where DC compo- 
40 nents of the transformed signal are set to a fixed length, and a code amount of second additional information that 
is to be attached to a second bit stream which is obtained by applying second variable length coding on the trans- 
formed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a code 

45 amount that is obtained by applying quantization and the second variable length coding on the AC components of 
the transformed signal, to be equal to or smaller than a differential code amount that is obtained by subtracting a 
larger one among the first total amount and the second total amount from a predetermined code amount; 
quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, by 
using said quantizer which is selected by said quantization estimating means; and 

so variable length coding manes for applying the first or second variable length coding on the quantized signal. 

[0046] As described above, quantization estimation in a coding process is performed by using plural VLCs, and a 
quantizer which, even when any one of the VLCs is used, does not exceed the specified code amount is selected. As 
a result, even when a bit stream which is compressed by using the present system is transformed into another com- 
55 pression system by using only bit stream transformation, it is possible to guarantee that the rate of the transformed bit 
stream can be set within a predetermined rate. In addition to VLCs, a quantizer is selected while estimating difference 
coding of DC components having a possibility of changing the rate of a bit stream, and the rate difference due to differ- 
ence in syntax, whereby the accuracy can be further improved. 
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[0047] A thirty-sixth invention of the present invention (corresponding to claim 36) is a video signal coding appara- 
tus characterized in that said apparatus comprises: 

motion vector detecting means for, for an input image, detecting a motion vector with respect to a predetermined 
s reference image; 

difference image producing means for, for the input image, producing a first difference image with respect to the 
reference image; 

fitter coefficient determining means for calculating visual importance of the input image on the basis of the input 
image and the first difference image, and determining a filter coefficient for performing a filter process on the input 
10 image; 

filter processing means for performing a filter process on the input image by using the filter coefficient, to produce 
a filter image; 

motion compensating means for performing motion compensation on the filter image by using the motion vector, to 
produce a second difference image; and 
is coding means for performing coding on the second difference image to produce a coded data. 

[0048] According to this configuration, a filter process is conducted on a region of lower visual importance, to 
reduce the code amount, so that a larger code amount can be allocated to a region of higher visual importance, and the 
image quality can be improved. 
20 [0049] A thirty-seventh of the present invention (corresponding to claim 37) is a video signal coding apparatus 
according to the 36th invention, characterized in that said filter coefficient determining means calculates visual impor- 
tance of the input image on the basis of an activity of the input image and an activity of the first difference image, and 
determines the filter coefficient. 

[0050] A thirty-eighth invention of the present invention (corresponding to claim 38) is a video signal coding appa- 
25 ratus according to the 36th or the 37 invention, characterized in that said filter coefficient determining means selects the 
filter coefficient for performing the filter process, from a plurality of filter coefficient candidates. 
[0051] A thirty-ninth invention of the present invention (corresponding to claim 39) is a video signal coding appara- 
tus characterized in that said apparatus comprises: 

30 motion vector detecting means for, for an input image, detecting a motion vector with respect to a predetermined 
reference image; 

difference image producing means for, for the input image, producing a first difference image with respect to the 
reference image; 

first filter processing means for performing a first filter process on the input image to produce a first filter image; 
35 filter parameter determining means for calculating visual importance of the input image on the basis of the input 
image and the first difference image, and determining a filter parameter for performing a second filter process on 
the input image and the first filter image; 

second filter processing means for performing a second filter process on the input image and the first filter image 
by using the filter parameter, to produce a second filter image; 
40 motion compensating means for performing motion compensation on the second filter image by using the motion 
vector, to produce a second difference image; and 

coding means for performing coding on the second difference image to produce a coded data. 

[0052] According to this configuration also, a filter process is conducted on a region of lower visual importance, to 
45 reduce the code amount, so that a larger code amount can be allocated to a region of higher visual importance, and the 
image quality can be improved. 

[0053] A fortieth invention of the present invention (corresponding to claim 40) is a video signal coding apparatus 
according to the 39th invention, characterized in that said filter parameter determining means calculates the visual 
importance on the basis of an activity of the input image and an activity of the first difference image, and determines 
so the filter parameter. 

[0054] A forty-first invention of the present invention (corresponding to claim 41) is a video signal coding apparatus 
according to the 39th or 40th invention, characterized in that said filter parameter determining means selects the filter 
parameter for performing the second filter process, from a plurality of filter parameter candidates. 
[0055] A forty-second invention of the present invention (corresponding to claim 42) is a video signal coding appa- 
55 ratus according to any one of the 36th to 41 st inventions, characterized in that the filter coefficient or the filter parameter 
is a coefficient in the predetermined unit of block. 

[0056] A forty-third invention of the present invention (corresponding to claim 43) is a video signal coding apparatus 
according to any me of the 36th to 41 st inventions, characterized in that the filter coefficient or the filter parameter is a 
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coefficient in the unit of pixel. 

[0057] A forty-fourth invention of the present invention (corresponding to claim 44) is a video signal coding appara- 
tus according to any one of the 36th to 43rd inventions, characterized in that said fitter coefficient determining means 
or said filter parameter determining means determines the fitter coefficient or the fitter parameter by curved surface 
5 approximation using the visual importance. 

[0058] According to this configuration, a filter coefficient or a fitter parameter is calculated by phase interpolation 
using visual importance. Therefore, the continuity in a block interface can be maintained, and a visual improvement can 
be realized. 

[0059] A forty-fifth invention of the present invention (corresponding to claim 45) is a video signal coding apparatus 
10 according to any one of the 36th to 43rd inventions, characterized in that said filter coefficient determining means or 
said filter parameter determining means places the visual importance at one of four comers in a block constituting the 
input image, and determines the filter coefficient or the filter parameter while. 

[0060] According to this configuration, in phase interpolation using visual importance, the visual importance can be 
placed in one of four corners of a block, whereby the calculation accuracy of the interpolation calculation can be 

75 reduced, and a reduction in the number of circuits in a calculation section can be realized. 

[0061 ] A forty-sixth invention of the present invention (corresponding to claim 46) is a video signal coding apparatus 
according to any one of the 36th to 43rd inventions, characterized in that said filter coefficient determining means or 
said filter parameter determining means performs edge detection on a block constituting the input image, and, when an 
edge exists, places the visual importance in an edge interface, and determines the filter coefficient or the fitter param- 

20 eter. 

[0062] According to this configuration, in phase interpolation using visual importance, the visual importance can be 
placed in an interface of an edge in a block, whereby the edge can be preserved, and an improvement of the image 
quality can be realized. 

[0063] A forty-seventh invention of the present invention (corresponding to claim 47) is a video signal coding appa- 
25 ratus according to any one of the 36th to 46th inventions, characterized in that said motion vector detecting means per- 
forms same motion vector detection on the input image to produce a difference image, and a motion vector 
corresponding to a picture type of the input image. 

[0064] According to this configuration, irrespective of the picture type of the input image, the same motion vector 
detection is performed to produce a difference image, whereby visual importance can be calculated at a higher accu- 

30 racy, and an improvement of the image quality of a reproduced image can be realized. 

[0065] A forty-eighth invention of the present invention (corresponding to claim 48) is a video signal coding appa- 
ratus according to any one of the 36th to 46th inventions, characterized in that said motion vector detecting means per- 
forms motion vector detection on the input image by bidirectional interframe prediction to produce a difference image, 
and a motion vector corresponding to a picture type of the input image. 

35 [0066] A forty-ninth invention of the present invention (corresponding to claim 49) is a video signal coding appara- 
tus characterized in that said apparatus comprises: 

difference image producing means for performing motion vector detection in the unit of block on an input image, to 
produce its motion vector, block type information indicative of information of the block coding, and a first difference 
40 image; 

filter parameter calculating means for calculating visual importance in a block in the unit of block, from the input 
image, the block type information, and the first difference image, and calculating a fitter parameter for controlling a 
degree of filtering in the unit of pixel, from the visual importance; 

filter coefficient determining means for determining a filter coefficient from a plurality of filter coefficient candidates, 
45 based on the fitter parameter; 

filter calculating means for performing a fitter calculation on the input image by using the filter coefficient to produce 
a filter image; 

motion compensating means for performing motion compensation on the filter image by using the motion vector 
and the block type information, to produce a second difference image; and 
so coding means for performing coding on the second difference image to produce a coded data. 

[0067] According to this configuration, a fitter process is conducted on a region of lower visual importance, to 
reduce the information amount, so that a larger code amount can be allocated to a region of higher visual importance, 
and the image quality can be improved. 
55 [0068] A fiftieth invention of the present invention (corresponding to claim 50) is a program recording medium char- 
acterized in that a program for realizing all or a part of means of the video signal coding apparatus according to any one 
of the 2nd to 3rd, 6th to 1 0th, 12th to 1 4th, 1 7th to 21 st, 27th to 31st, and 34th to 49th inventions by a computer is stored 
in said medium. 
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Brief Description of Drawings 
[0069] 

s Fig. 1 is a flowchart illustrating a video signal coding method of Embodiment 1 of the invention. 

Fig. 2 is a flowchart illustrating a coding method used in coding of a bit stream which is coded by the video signal 
coding method of Embodiment 1 of the invention of Fig. 1 , by a video signal coding method other than the video 
signal coding method of Fig. 1 . 

Fig. 3 is a flowchart illustrating a video signal coding method of Embodiment 1 of the invention which is different 
10 from that of Fig. 1. 

Fig. 4 is a flowchart illustrating a coding method used in coding of a bit stream which is coded by the video signal 
coding method of Embodiment 1 of the invention of Fig. 3, by a video signal coding method other than the video 
signal coding method of Fig. 3. 

Fig. 5 is a block diagram of a video signal coding apparatus of Embodiment 2 of the invention. 
is Fig. 6 is a block diagram of a video signal coding apparatus of Embodiment 2 of the invention which is different from 
Fig. 5. 

Fig. 7 is a block diagram of a video signal coding apparatus of Embodiment 2 of the invention which is different from 
Figs. 5 and 6. 

Fig. 8 is a block diagram of a decoding apparatus which decodes a bit stream produced in Fig. 7. 
20 Fig. 9 is a flowchart illustrating a video signal coding method of Embodiment 3 of the invention. 
Fig. 1 0 is a block diagram of a video signal coding apparatus of Embodiment 3 of the invention. 
Fig. 11 is a view illustrating the operation of a quantization estimator 1005 of the video signal coding apparatus of 
Embodiment 3 of the invention. 

Fig. 12 is a block diagram of a video signal coding apparatus of Embodiment 4 of the invention. 
25 Fig. 13 is a block diagram of Embodiments 5, 7, 8, 9, 10, 1 1 , and 12 of the invention. 
Fig. 14 is a block diagram of Embodiment 6 of the invention. 

Fig. 15 is a view showing relationships between a block activity and visual importance in Embodiments 5. 6, 7, 8, 
9, and 10 of the invention. 

Fig. 16 is a view showing a calculation of a filter parameter from a filter parameter in the unit of block by curved sur- 
30 face approximation in Embodiments 5, 6, and 7 of the invention. 

Fig. 17 is a view showing relationships between a filter parameter and a filter coefficient in Embodiment 5 of the 
invention. 

Fig. 18 is a view showing a calculation of a filter parameter in the unit of pixel from visual importance by curved sur- 
face approximation in Embodiment 8 of the invention. 
3$ Fig. 19 is a view showing a calculation of a filter parameter in the unit of pixel from visual importance by curved sur- 
face approximation in Embodiment 9 of the invention. 

Fig. 20 is a view showing placement of visual importance in Embodiment 10 of the invention. 

Fig. 21 is a view showing an edge detecting method in Embodiment 10 of the invention. 

Fig. 22 is a view illustrating a calculation of visual importance by detection of a change of a motion vector. 

40 

Best Mode for Carrying Out the Invention 

[0070] Hereinafter, embodiments of the invention will be described with reference to drawings. 
45 (Embodiment 1) 

[0071] Fig. 1 is a flowchart illustrating a video signal coding method of Embodiment 1 of the invention. The video 
signal coding method of the embodiment is a method in which coding is performed so that, even when a bit stream that 
has been produced by a first compression system so as to be set within a desired code amount is transformed to a bit 

so stream of a second compression system, the code amount can be set within the desired code amount. 

[0072] In the above-mentioned first compression system, DC components which are obtained by applying DCT 
(Discrete Cosine Transform) on an input digital video signal are set at a fixed length, AC components are quantized and 
variable length coded, additional information is added to the DC and AC components to produce a bit stream, and the 
bit stream is recorded. By contrast, in the second compression system, the bit stream is received from the first com- 

55 pression system, the DC components are not applied to fixed-length recording, but coded by applying DPCM (Differ- 
ence Predictive Coding), the AC components are applied to variable length decoding corresponding to the variable 
length coding which is applied in the first compression system, and then coded by applying variable length coding other 
than that which is applied in the first compression system, additional information is coded by using a method other than 
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that which is applied in the first compression system, and a bit stream is produced from the DC and AC components 
and the additional information. 

[0073] First the production of a bit stream in the first compression system will be described. 
[0074] Fig. 1 is a flowchart illustrating the production of a bit stream in the first compression system. 

s [0075] In the first compression system, as shown in Fig. 1 , an input digital video signal is first DCT transformed. In 
the DCT transformed digital video signal, DC components are recorded at a fixed length. Also additional information is 
recorded at a fixed length by a method based on the coding standard of the first compression system. AC components 
of the DCT transformed digital video signal are quantized and coded by the method based on the coding standard of 
the first compression system. When the amount of the quantized and coded components fails to be set within a prede- 

w termined code amount, the bit stream produced by the first compression system cannot be transmitted. In the quanti- 
zation of the AC components, therefore, the quantization must be performed so that the amount of the quantized and 
coded components can be set within the predetermined code amount. In the case where, from the bit stream produced 
by the first compression system, another bit stream is to be produced by the second compression system, when the 
code amount of the bit stream fails to be set within the predetermined code amount, the bit stream produced by the sec- 

75 ond compression system cannot be transmitted. In other words, in order to enable the bit stream produced by the first 
compression system to be transmitted, and also to enable the bit stream produced by the second compression system 
to be transmitted, the selection of the method of quantizing the AC components in the first compression system, or spe- 
cifically a quantizer which is used for quantizing the AC components in the first compression system is important. 
[0076] Therefore, a method of quantizing the AC components in the first compression system, i.e., the selection of 

20 a quantizer which is used in the quantization will be described. 

[0077] First, with respect to the DC components of the DCT transformed signal, the code amount in the case where 
the DC components are coded by applying DPCM (Difference Predictive Coding) performed in the second compression 
system is estimated. Next, a first additional information amount in the case where the additional information is com- 
pressed in the first system, and a second additional information amount in the case where the additional information is 

25 compressed in the second system are obtained. 

[0078] By using the above-mentioned information, a larger one is obtained among the code amount of the DC com- 
ponents in the case where coding is performed in the first compression system and the code amount of the DC compo- 
nent applied with DPCM in the case where coding is performed in the second compression system. Similarly, a larger 
one of the first additional information amount in the case where coding is performed in the first compression system, 

30 and a second additional information amount in the case where coding is performed in the second compression system 
is obtained. 

[0079] Next, a value which is obtained by subtracting, from the predetermined code amount, the thus obtained 
larger one of the code amount of the DC components in the case where coding is performed in the first compression 
system, and that in the case where coding is performed in the second compression system, and the larger one of the 
35 first additional information amount and the second additional information amount is calculated as code amount alloca- 
tion for the AC components. 

[0080] Thereafter, a quantizer is selected which, when the AC components are quantized and variable length coded 
in the first compression system and the second compression system, enables the code amounts of both the AC com- 
ponents after the variable length codings to be set within the thus obtained allocated code amount for the AC compo- 
40 nents. The AC components are quantized and then variable length coded by using the selected quantizer. The 
information of the used quantizer, the DC components, and the additional information are added to the coded AC com- 
ponents to produce a first bit stream in the first compression system. 

[0081] Next, a method of transforming the first bit stream produced in the first compression system to a second bit 
stream of the second compression system will be described. 

45 [0082] Fig. 2 shows a method of transforming the first bit stream which is produced in the first compression system 
as described above, to the second bit stream of the second compression system. As shown in Fig. 2, the first bit stream 
produced in the first compression system is input, the DC components are coded by applying DPCM (Difference Pre- 
dictive Coding), and the additional information is coded by applying coding in the second compression system. The AC 
components are transformed to AC components in the second compression system by applying variable length decod- 

so ing, and then applying variable length coding used in the second compression system. Thereafter, the second bit 
stream in the second compression system is produced from the DC components, the AC components, and second 
additional information which are coded in the second compression system. The code amount of the thus obtained sec- 
ond bit stream is controlled so as to be equal to or smaller than the predetermined code amount in the coding of the 
first bit stream, and hence equal to or smaller than a code amount at which transmission is enabled. 

55 [0083] In the above, the example has been described in which, in the first compression system, when the DC com- 
ponents are to be coded, coding is performed at a fixed length, and, in the second compression system, when the DC 
components are to be coded, coding is performed by applying DPCM (Difference Predictive Coding). In the following, 
an example will be described in which, in the first compression system, when the DC components are to be coded, cod- 
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ing is performed by applying DPCM (Difference Predictive Coding), and, in the second compression system, when the 
DC components are to be coded, coding is performed at a fixed length. In the following, namely, on the first compression 
system and the second compression system using Figs. 3 and 4, such example is described that is opposite to the 
example which is described using by Figs. 1 and 2. 
5 [0084] Fig. 3 is a flowchart illustrating a production of a bit stream in a first compression system which is different 
from that of Fig. 1 , and Fig. 4 is a flowchart illustrating a method of transforming the bit stream produced in the first com- 
pression system shown in Fig. 3 to a second bit stream in the second compression system. 

[0085] In the method shown in Fig. 1 , DPCM (Difference Predictive Coding) is used only for estimating the code 
amount in the application of DPCM on the DC components. By contrast, in the coding method shown in Fig. 3, DPCM 

w (Difference Predictive Coding) is used not only for estimating the code amount in the application of DPCM on the DC 
components, but also for producing the bit stream together with the estimation of the code amount. 
[0086] Also in the coding method shown in Fig. 3, as described in the coding method shown in Fig. 1 , with respect 
to the DC components of the DCT transformed signal, a larger one of the code amount of the DC components, and that 
in the case where coding is performed by applying DPCM performed is obtained. Furthermore, a larger one of the first 

is additional information amount in the case where coding is performed in the first compression system, and the second 
additional information amount in the case where coding is performed in the second compression system is obtained. 
[0087] Next, a value which is obtained by subtracting, from the predetermined code amount, the thus obtained 
larger one of the code amount of the DC components and that of the DC components due to DPCM, and the larger one 
of the first additional information amount and the second additional information amount is calculated as code amount 

20 allocation for the AC components. Thereafter, a quantizer is selected which, when the AC components are quantized 
and variable length coded in the first compression system and the second compression system, enables the code 
amount of both the AC components after the variable length codings to be set within the thus obtained allocated code 
amount for the AC components. 

[0088] The AC components are quantized and then variable length coded by using the selected quantizer. The 

25 information of the used quantizer, the DC components which has applied DPCM, and the first additional information are 
added to the coded Ac components to produce a first bit stream in the first compression system. 
[0089] By contrast, in the bit stream transforming method shown in Fig. 4, although a method of decoding the first 
bit stream produced by the method shown in Fig. 3 to transform it to another second bit stream is shown, the coding of 
the DC components is different from the cases of Figs. 1 and 3 as described above, and hence a signal which has 

30 applied DPCM is decoded unlike the case of Fig. 2. 

[0090] As described above, in the video signal coding method of Embodiment 1 of the invention, compression in 
the first compression system is performed also in consideration of the code amount in the case where coding is per- 
formed in the second compression system. Therefore, the code amounts of both the first bit stream which is produced 
in the first compression system, and the second bit stream which is obtained by transforming the first bit stream in the 

35 second compression system can be set to fall within a predetermined code amount. 

[0091] The compression system used in the embodiment is an example, and the same effects can be attained by 
another configuration. In summary, coding is performed while controlling so that a value that is obtained by adding to 
an element in which the code amount is changed each time when bit stream transformation between different high-effi- 
ciency codings is performed, the maximum value of the code amount of corresponding data other than the element of 

40 the variable code amount, such as additional information is equal to or smaller than a predetermined code amount. 
According to this configuration, even when bit stream transformation is performed, the code amount does not exceed 
the predetermined code amount. 

[0092] In the embodiment, the case where two kinds of compression systems are used has been described. The 
number of the kinds of compression systems is not limited to two, and three or more kinds of compression systems may 
45 be used. In this case, it is required only that a bit stream before transformation is produced so that the code amounts of 
bit streams which are respectively produced in the compression systems are equal to or smaller than the predetermined 
code amount. 

[0093] Although the degree of guarantee is lowered, the selection of a quantizer for quantizing AC components may 
be performed while omitting a part such as prediction of the amount of additional information or DC components. 
so [0094] In Embodiment 1 described above, when a quantizer for quantizing AC components in the first compression 
system is to be selected, DCT transformed DC components are used for estimating the code amount of DC compo- 
nents and components which are obtained by applying DPCM on the DC components. Alternatively, in order to estimate 
the code amount, DCT transformed DC components may not be used, and an average value of pixels of the input digital 
signal maybe used while regarding the value as the value of DCT transformed DC components. 

55 

(Embodiment 2) 

[0095] Fig. 5 is a block diagram of a video signal coding apparatus of Embodiment 2 of the invention, 501 denotes 
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an input terminal into which a digital video signal is to be input 502 denotes an orthogonal transformer which performs 
orthogonal transformation on the input signal, 503 denotes a quantizer which quantizes the input signal, 504 denotes a 
variable length coder which performs variable length coding on the input signal, 505 denotes a quantization estimator 
which determines a quantizer that is to be used for quantizing AC components of the digital video signal in the quantizer 
5 503, 506 denotes an additional information amount estimator which estimates an additional information amount in cod- 
ing of the input video signal, 507 denotes a DC component code amount estimator which estimates a code amount in 
coding of DC components of the input signal, and 508 denotes a bit stream producer which produces a bit stream. The 
compression method in the video signal coding apparatus of the embodiment is identical with the video signal coding 
method of Embodiment 1 . 

io [0096] The thus configured video signal coding apparatus of Embodiment 2 of the invention will be described with 
reference to Fig. 5. 

[0097] A digital video signal which is input from the input terminal 501 is orthogonal transformed by the orthogonal 
transformer 502, and then output to the quantizer 503, the quantization estimator 505, the additional information 
amount estimator 506, and the DC component code amount estimator 507. 

75 [0098] The DC component code amount estimator 507 estimates the code amount in the case where coding is per- 
formed on DC components of the input signal by applying DPCM (Difference Predictive Coding) performed in the sec- 
ond compression system, compares the estimated code amount with the code amount in the case where fixed-length 
recording is performed in the first compression system, or compares the code amount of DC components which have 
applied DPCM (Difference predictive Coding) with that of DCT transformed DC components, and outputs information of 

so the larger code amount to the quantization estimator 505. At the same time, the DC component code amount estimator 
507 outputs the DC components to the bit stream producer 508. 

[0099] The additional information amount estimator 506 estimates a first additional information amount in the case 
where the additional information is compressed in the first compression system, and a second additional information 
amount in the case where the additional information is compressed in the second compression system, compares the 

25 code amounts with each other, and outputs information of the larger one of the code amounts to the quantization esti- 
mator 505. At the same time, the additional information amount estimator 506 compresses the additional information in 
the first compression system, and outputs the result to the bit stream producer 508 as first additional information. 
[0100] The quantization estimator 505 calculates a value which is obtained by subtracting, from a predetermined 
code amount, the code amount of information output from the additional information amount estimator 506 and the DC 

30 component code amount estimator 507, as code amount allocation for the AC components. The estimator selects a 
quantizer which, when the AC components are quantized and variable length coded in the first compression system and 
the second compression system, enables both the code amounts of the AC components after the variable length cod- 
ings to be set within the thus obtained allocated code amount for the AC components, and outputs its information to the 
quantizer 503. The quantizer 503 quantizes AC components from the orthogonal transformer 502 by using the quan- 

35 tizer which is selected by the quantization estimator 505, and outputs the result to the variable length coder 504. The 
variable length coder 504 performs variable length coding on the input signal, and outputs the result to the bit stream 
producer 508. At this time, variable length coded AC components, and information of the used quantizer are sent to the 
bit stream producer 50. 

[0101] Next, the bit stream producer 508 produces a bit stream from the DC components from the DC component 
40 code amount estimator 507, the first additional information from the additional information amount estimator 506, the 
variable length coded AC components from the variable length coder 504, and the information of the used quantizer, 
and outputs the bit stream. 

[0102] As described above, the video signal coding apparatus shown in Fig. 5 can produce a bit stream which is 
set within a predetermined code amount, both in the first compression system and the second compression system. 

45 [0103] In the embodiment described with reference to Fig. 5, from the DC components of the digital video signal 
which has been orthogonal transformed (DCT transformed) by the orthogonal transformer 502, the DC component 
code amount estimator 507 estimates the code amount in the case where the DC components are coded by DPCM 
(Difference Predictive Coding). Alternatively, as shown in Fig. 6, the DC component code amount estimator 507 of the 
video signal coding apparatus may not be placed in a position subsequent to the orthogonal transformer 502, but in a 

so position where the digital video signal from the input terminal 501 is directly input to the estimator, the value of the 
DPCM coded DC components which is estimated by the DC component code amount estimator 507 may be regarded 
as average value of pixels of the digital video signal from the input terminal 501 , and the value may be used. 
[0104] In the embodiment described with reference to Figs. 5 and 6, the digital video signal from the input terminal 
501 is directly input to the orthogonal transformer 502 and the DC component code amount estimator 507. Alternatively, 

55 in Fig. 5, a block divider which divides the digital video signal into, for example, blocks each consisting of 8 x 8 or 64 
pixels may be disposed between the input terminal 501 and the orthogonal transformer 502, and, in Fig. 6, a block 
divider which divides the digital video signal into blocks may be disposed between the input terminal 501 and the 
orthogonal transformer 502, and between the input terminal 501 and the DC component code amount estimator 507. 
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[0105] The video signal coding apparatus of Embodiment 2 described with reference to Fig. 5 is an apparatus cor- 
responding to the video signal coding method of Embodiment 1 described with reference to Fig. 1 . In addition to the 
video signal coding apparatus of Embodiment 2 described with reference to Fig. 5, there is a video signal coding appa- 
ratus corresponding to the video signal coding method of Embodiment 1 described with reference to Fig. 3. In the video 

5 signal coding apparatus corresponding to the video signal coding method of Fig. 3. the circuit is configured so that the 
DC components are applied to DPGM not only in order to select a quantizer for quantizing the AC components, and a 
bit stream is produced by using a result of coding of the DC components by DPCM. Also in such a case, in the same 
manner as the video signal coding apparatus shown in Fig. 5. the effect that, in both the first compression system and 
the second compression system, the code amount of the produced bit stream can be set within a predetermined code 

10 amount is attained. 

[01 06] In the embodiment described with reference to Fig. 5 or 6, production of a bit stream in the first compression 
system has been described. Next, a video signal coding apparatus which can simultaneously produce a bit stream of 
the first compression system and that of the second compression system will be described with reference to Fig. 7. 
[0107] In Rg. 7, 701 denotes an input terminal into which a video signal that is identical with the digital video signal 

is input to the input terminal 501 of Fig. 5 is to be input, 702 denotes an orthogonal transformer which performs orthogonal 
transformation on the input signal, 703 denotes a quantizer which quantizes the input signal, 704 denotes a first variable 
length coder which performs first variable length coding on the input signal, 705 denotes a first variable length decoder 
which performs first variable length decoding on the input signal, 706 denotes a second variable length coder which per- 
forms second variable length coding on the input signal, 707 denotes a quantization estimator which determines a 

20 quantizer that is to be used for quantizing AC components of the digital video signal in the quantizer 703, 708 denotes 
an additional information amount estimator which estimates an additional information amount in coding of the input 
video signal, and 709 denotes a DC component code amount estimator which estimates a code amount in coding of 
DC components of the input signal. The input terminal 701 is identical with the input terminal 501 , the orthogonal trans- 
former 702 is identical with the orthogonal transformer 502, the quantizer 703 is identical with the quantizer 503, and 

25 the first variable length coder 704 is identical with the variable length coder 504. Furthermore, the quantization estima- 
tor 707 is identical with the quantization estimator 505, the additional information amount estimator 708 is identical with 
the additional information amount estimator 506, and the DC component code amount estimator 709 is identical with 
the DC component code amount estimator 507. 

[0108] Fig. 7 shows a method of transforming a first bit stream which has applied the first variable length coding to 
30 a second bit stream which has applied the second variable length coding. A video signal which is input from the input 
terminal 701 is transformed into a bit stream which has been compressed and applied to the first variable length coding, 
by the orthogonal transformer 702, the quantizer 703, and the first variable length coder 704. In order to output a bit 
stream which has applied the second variable length coding in the compression process, one of methods of coding the 
quantized video signal by the second variable length coder 706, and of decoding the video signal which has applied the 
35 first variable length coding, by the first variable length decoder 705, and coding the decoded signal by the second var- 
iable length coder 706 may be used. 

[0109] Next, Fig. 8 is a block diagram of a decoding apparatus which decodes the bit stream produced in Fig. 7. In 
Fig. 8, 801 denotes an input terminal into which the compressed bit stream from the first variable length coder 704 is to 
be input, 802 denotes a first variable length decoder which performs first variable length decoding on the input signal, 
40 803 denotes an inverse quantizer which inverse quantizes the input signal, 804 denotes an inverse orthogonal trans- 
former which performs inverse orthogonal transformation on the input signal, and 805 denotes a second variable length 
coder which performs second variable length coding on the input signal. 

[0110] Fig. 8 shows a method of, in a decoding process, transforming a bit stream which has applied the first vari- 
able length coding to a bit stream which has applied the second variable length coding, and that of decoding the bit 

45 stream which has applied the first variable length coding. A bit stream which is input from the input terminal 801 is 
expanded (decoded) by the first variable length decoder 802, the inverse quantizer 803, and the inverse orthogonal 
transformer 804, to be transformed to a video signal. The output of a bit stream which has applied the second variable 
length coding in the expansion process is enabled by decoding the input signal by the first variable length decoder 802, 
and coding the decoded signal by the second variable length coder 805. As a configuration for the above, as shown in 

so Fig. 8, a configuration in which the first variable length decoder 802 and the second variable length coder 805 are dis- 
posed inside the decoding apparatus, or another configuration in which the first variable length decoder 802 and the 
second variable length coder 805 are not disposed inside the decoding apparatus, but disposed outside the decoding 
apparatus may be used. In this way, the first variable length decoder 802 and the second variable length coder 805 may 
be disposed inside the decoding apparatus, or outside the decoding apparatus. Similarly, the first variable length 

55 decoder 705 and the second variable length coder 706 of the video signal coding apparatus shown in Fig. 7 may be 
disposed inside the video signal coding apparatus, or outside the video signal coding apparatus. 
[0111] Figs. 7 and 8 show configurations in which only the variable length coding is changed. The coding of DC 
components, and the transformation to additional information for a bit stream are performed in the same manner as the 
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transformations for items other than AC components which have been described with reference to Figs. 2 and 4. 
[0112] The compression system used in above-described Embodiment 1 and Embodiment 2 is an example, and 
the same effects can be attained by another configuration. In summary, coding is performed while controlling so that a 
value that is obtained by adding to an element in which the code amount is changed each time when bit stream trans- 
s formation between different high-efficiency codings is performed, the maximum value of the code amount of corre- 
sponding data other than the element of the variable code amount, such as additional information is equal to or smaller 
than a predetermined code amount According to this configuration, even when bit stream transformation is performed, 
the code amount does not exceed the predetermined code amount. 

[0113] In above-described Embodiment 1 and Embodiment 2, the case where two kinds of compression systems 
10 are used has been described. The number of the kinds of compression systems is not limited to two, and three or more 
kinds of compression systems may be used. In this case, it is required only that a bit stream before transformation is 
produced so that the code amounts of bit streams which are respectively produced in the compression systems are 
equal to or smaller than the predetermined code amount. 

[0114] In above-described Embodiment 1 and Embodiment 2, although the degree of guarantee is lowered, the 
75 selection of a quantizer for quantizing AC components may be performed while omitting a part such as prediction of the 
amount of additional information or DC components. 

[0115] In the above, the means constituting the video signal coding apparatus of Embodiment 2 are described as 
hardware. Alternatively, the whole or a part of the means constituting the video signal coding apparatus may be 
replaced with software having the same functions as corresponding ones of the above-mentioned hardware. 

20 

(Embodiment 3) 

[0116] Next, a video signal coding method and a video signal coding apparatus of Embodiment 3 of the invention 
will be described with reference to Figs. 9, 1 0, and 1 1 . 
25 [0117] Fig. 9 is a flowchart illustrating the video signal coding method of Embodiment 3 of the invention, and Fig. 
10 is a block diagram of the video signal coding apparatus of Embodiment 3 of the invention. Fig. 1 1 will be described 
later. 

[0118] As shown in Fig. 10, the video signal coding apparatus of Embodiment 3 of the invention is configured by an 
orthogonal transformer 2002, a quantizer 2003, a variable length coder 2004, a quantization estimator 2005, an addi- 
30 tional information amount estimator 2006, a DC component code amount estimator 2007, and a bit stream producer 
2008. 

[0119] The orthogonal transformer 2002, the quantizer 2003, the variable length coder 2004, the additional infor- 
mation amount estimator 2006, and the bit stream producer 2008 operate in the same manner as corresponding ones 
of the orthogonal transformer 502, the quantizer 503, the variable length coder 504, the additional information amount 

35 estimator 506, and the bit stream producer 508 of above-described Embodiment 2 of Fig. 5, respectively. 

[01 20] By contrast, the functions of the quantization estimator 2005 and the DC component code amount estimator 
2007 are different the function of the quantization estimator 505 or the DC component code amount estimator 507 of 
Embodiment 2. In Embodiment 3, therefore, differences from Embodiments 1 and 2 will be described. 
[0121] The DC component code amount estimator 2007 estimates a difference predictive code amount in the case 

40 where difference predictive coding is performed on DC components of a digital video signal which is discrete cosine 
transformed and quantized previously in time to a transformed signal which is transformed by the orthogonal trans- 
former 2002 to function as the object of the quantization. 

[0122] The quantization estimator 2005 estimates a second system code amount of a total of the difference predic- 
tive code amount which is estimated by the DC component code amount estimator 2007, and the code amount in the 
45 case where, in the second compression system, variable length coding is performed on AC components of the digital 
video signal which is discrete cosine transformed and quantized previously in time. The quantization estimator 2005 
compares a preset ideal code amount with the second system code amount. 

[0123] Fig. 1 1 shows the temporal change of the ideal code amount, and that of the second system code amount. 
In Fig. 11 , the temporal change of the ideal code amount is indicated by a broken line, and that of the second system 
so code amount is indicated by a solid line. The portion where the ideal code amount is larger than the second system 
code amount in the case where the ideal code amount and the second system code amount are compared with each 
other at each timing is hatched. 

[0124] In Embodiment 3, the second system code amount means a total code amount of the difference predictive 
code amount which is previous in time to the transformed signal that is the object of the quantization, and the code 
55 amount in the case where variable length coding is performed on AC components in the second compression system. 
The ideal code amount is stepwise increased by a constant value with the passage of time. 

[01 25] When the second system code amount is equal to or smaller than the ideal code amount as a result of com- 
parison of the ideal code amount and the second system code amount, the quantization estimator 2005 calculates a 
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value which is obtained by subtracting the code amount of information output from the additional information amount 
estimator 2006 from a predetermined code amount in the first compression system, as code amount allocation for the 
AC components, selects a quantizer which enables the code amount to be set within the allocated code amount, and 
outputs its information to the quantizer 2003. 

5 [0126] By contrast when the second system code amount is larger than the ideal code amount, a value which is 
obtained by subtracting the ideal code amount from the second system code amount is subtracted from the predeter- 
mined code amount in the first compression system, and subtracting from the result the code amount of information out- 
put from the additional information amount estimator 2006 is calculated as code amount allocation for the AC 
components. A quantizer which enables the code amount to be set within the allocated code amount is selected, and 

10 its information is output to the quantizer 2003. 

[0127] Thereafter, the quantizer 2003 quantizes AC components of the input video signal which is the object of 
quantization and supplied from the orthogonal transformer 2002, by using the quantizer which is selected by the quan- 
tization estimator 2005, and outputs the result to the variable length coder 2004. The variable length coder 2004 per- 
forms variable length coding on the input signal, and outputs the result to the bit stream producer 2008. 

75 [0128] Next, the bit stream producer 2008 produces a bit stream from the additional information from the additional 
information amount estimator 2006, and the variable length coded AC and DC components from the variable length 
coder 2004, and outputs the bit stream. 

[0129] In above-described Embodiment 3, the DC component code amount estimator 2007 estimates the differ- 
ence predictive code amount in the case where difference predictive coding is performed on DC components of a digital 

20 video signal which is discrete cosine transformed and quantized previously in time to a transformed signal which is the 
object of the quantization. Alternatively, the DC component code amount estimator 2007 may estimate a code amount 
in the case where DC components of a digital video signal which is discrete cosine transformed and quantized previ- 
ously in time to a transformed signal which is the object of the quantization is set to have a fixed length, or in other words 
decoding of difference predictive coding is performed, and it may be used in place of the above-mentioned difference 

25 predictive code amount. 

[01 30] In the alternative, the quantization estimator 2005 estimates a first system code amount of a total of the code 
amount which is estimated by the DC component code amount estimator 2007, and the code amount in the case where, 
in the first compression system, variable length coding is performed on AC components of a digital video signal which 
is discrete cosine transformed, discrete predictive coded, and quantized previously in time, and compares a preset ideal 

30 code amount with the first system code amount. 

[0131] In above-described Embodiment 3, the second system code amount means a total code amount of the dif- 
ference predictive code amount which is previous in time to the transformed signal that is the object of the quantization, 
and the code amount in the case where variable length coding is performed on AC components in the second compres- 
sion system. Alternatively, the second system code amount may not be a total code amount, but a part of the total, for 

35 example, a code amount of a partial period immediately before the transformed signal which is the object of the quan- 
tization. Similarly, the first system code amount may not be a total code amount, but a part of the total. In this case, the 
ideal code amount means an ideal code amount in a period when the second system code amount or the first system 
code amount is defined. 

[0132] The means constituting the video signal coding apparatus of above-described Embodiment 3 may be con- 
40 figured as hardware, or may be replaced with software having the same functions as corresponding ones of the above- 
mentioned hardware. 

(Embodiment 4) 

45 [0133] Next, a video signal coding method and a video signal coding apparatus of Embodiment 4 of the invention 
will be described with reference to Fig. 12. 

[0134] Fig. 12 is a block diagram of the video signal coding apparatus of Embodiment 4 of the invention. As shown 
in Fig. 12, the video signal coding apparatus of Embodiment 4 of the invention is configured by an orthogonal trans- 
former 2202, a quantizer 2203, a variable length coder 2204, a quantization estimator 2205, a first detector 2206, a see- 
so ond detector 2207, and a bit stream producer 2208. 

[0135] The orthogonal transformer 2202, the quantizer 2203, the variable length coder 2204, and the bit stream 
producer 2208 operate in the same manner as corresponding ones of the orthogonal transformer 502, the quantizer 
503, the variable length coder 504, and the bit stream producer 508 of above-described Embodiment 2 of Fig. 5, 
respectively. 

55 [0136] By contrast, the function of the quantization estimator 2205 is different that of the quantization estimator 505 
of Embodiment 2. In place of the additional information amount estimator 506 and the DC component code amount esti- 
mator 507 which are disposed in the video signal coding apparatus of Embodiment 2 of Fig. 5, the video signal coding 
apparatus of Embodiment 4 comprises the first detector 2206 and the second detector 2207. 
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[0137] In Embodiment 4, therefore, differences from Embodiments 1 and 2 will be described. 
[0138] The first detector 2206 detects the size of a total (first total) of the code amount in the case where the DC 
components of the input signal are recorded at a fixed length in the first compression system, and a first additional infor- 
mation amount which is to be added to the input signal in the case where the AC components of the input signal are 
5 compressed in the first compression system, and outputs the information of the size to the quantization estimator 2205. 
At the same time, the first detector 2206 outputs the DC components and the first additional information amount to the 
bit stream producer 2208. 

[0139] The second detector 2207 estimates the code amount in the case where coding is performed by applying 
DPCM (Difference Predictive Coding) performed in the second compression system, on DC components of the input 
io signal, detects the size of a total (second total) of the code amount and a second additional information amount which 
is to be added to the input signal in the case where the AC components of the input signal are compressed in the sec- 
ond compression system, and outputs the information of the size to the quantization estimator 2205. 
[0140] The quantization estimator 2205 calculates a value which is obtained by subtracting, from the predeter- 
mined code amount, a larger one of the first total detected by the first detector 2206, and the second total detected by 
75 the second detector 2207, as code amount allocation for the AC components, selects a quantizer which, when the AC 
components are quantized and variable length coded in the first compression system and the second compression sys- 
tem, enables the code amount of both the AC components after the variable length codings to be set within the thus 
obtained allocated code amount for the AC components, and outputs its information to the quantizer 2203. 
[0141 ] Thereafter, the quantizer 2203 quantizes the AC components of the input video signal which is the object of 
20 quantization and supplied from the orthogonal transformer 2202, by using the quantizer which is selected by the quan- 
tization estimator 2205, and outputs the result to the variable length coder 2204. The variable length coder 2204 per- 
forms variable length coding on the input signal, and outputs the result to the bit stream producer 2208. 
[0142] Next, the bit stream producer 2208 produces a bit stream from the DC components and the first additional 
information from the first detector 2206, and the variable length coded AC components from the variable length coder 
25 2204, and outputs the bit stream. 

[0143] In above-described Embodiment 4, the first detector 2206 detects the size of a total of the code amount in 
the case where the DC components of the input signal are recorded at a fixed length in the first compression system, 
and the first additional information amount, and the second detector 2207 detects the size of a total of the code amount 
in the case where coding is performed by applying DPCM (Difference Predictive Coding) performed in the second corn- 
so pression system, on DC components of the input signal, and a second additional information amount. Alternatively, the 
first detector 2206 may detect the size of a total of the code amount in the case where coding is performed by applying 
DPCM (Difference Predictive Coding) performed in the second compression system, on DC components of the input 
signal, and set the size as the first total, and the second detector 2207 may detect the size of a total of the code amount 
in the case where the DC components of the input signal are recorded at a fixed length in the first compression system, 
35 and the first additional information amount, and set the size as the second total. 

[0144] The means constituting the video signal coding apparatus of above-described Embodiment 4 may be con- 
figured as hardware, or may be replaced with software having the same functions as corresponding ones of the above- 
mentioned hardware. 

40 (Embodiment 5) 

[0145] Next, Embodiment 5 of the invention will be described with reference to Figs. 13, 15, 16, and 17. 
[0146] In Fig. 13, 901 denotes an inputting section, 902 denotes a motion vector detecting section, 903 denotes a 
filter parameter calculating section, 904 denotes a filter coefficient determining section, 905 denotes a filter calculating 
45 section, 906 denotes a motion compensating section, 907 denotes a coding section, 908 denotes a local decoder, and 
909 denotes an outputting section. 

[0147] The operation of the thus configured embodiment will be described. 

[0148] An image signal which is input from the inputting section 901 is input to the motion vector detecting section 
902, the filter parameter calculating section 903, and the filter calculating section 905. Irrespective of the picture type of 
so the input image, the motion vector detecting section 902 performs motion vector detection on the input image with 
respect to a reference image stored in a memory, and outputs a motion vector and a first difference image. The motion 
vector is input to the motion compensating section 906, and the first difference image is input to the filter parameter cal- 
culating section 903 respectively. 

[0149] The filter parameter calculating section 903 calculates a first activity in the unit of block from the input image. 
55 and a second activity in the unit of block from the first difference image. From the first activity and the second activity, 
thereafter, visual importance which indicates the degree of visual importance in the unit of block with respect to the 
input image is calculated. In a region containing an edge and the like, the first activity is large, but the second activity is 
small because the motion compensation is effective. By contrast, in a region containing a signal of high randomness 
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such as noises, both the first activity and the second activity are large. 

[0150] In the case where a sum of absolute values of differences between an intrablock pixel and a block average 
is used as an activity, with respect to a region containing an edge and the like, usually, it is often that the first activity is 
1 ,000 or larger and the second activity is 1 00 or smaller, and it is characteristic that the second activity is smaller than 

5 the first activity. By contrast, with respect to a signal of high randomness, it is often that both the first activity and the 
second activity are 1,000 or larger, and it is characteristic that the second activity does not become small. 
[0151] In the specification, the visual importance is a degree at which a man pays attention when evaluation is per- 
formed on an image. With respect to a region of high edge and saturation, a man pays attention at a high degree, or 
visual importance is high. With respect to a region of high noise and randomness, a man pays attention at a low degree, 

10 or visual importance is low. From the visual importance, a filter parameter which is a parameter for controlling the 
degree of filtering in the unit of pixel on the input image is calculated. The filter parameter is input to the fitter coefficient 
determining section 904. 

[0152] The filter coefficient determining section 904 determines a filter coefficient from the input filter parameter. 
The filter coefficient is input to the filter calculating section 905. The filter calculating section 905 performs a filter calcu- 
75 lation on the input image by using the input filter coefficient, to produce a filter image. The filter image is input to the 
motion compensating section 906. 

[0153] When the picture type of the input filter image is a P -picture or a B-picture, the motion compensating section 
906 produces a predictive image from the input motion vector and the reference image stored in the memory, calculates 
the difference between the predictive image and the filter image, and outputs a second difference image. The second 
20 difference image is input to the coding section 907. When the picture type of the input fitter image is an l-picture, the 
fitter image is deemed as a second difference signal, and input to the coding section 907. 

[0154] The coding section 907 codes the input second difference image, and outputs a coded data. The coded data 
is input to the local decoder 908 and the outputting section 909. The local decoder 908 decodes the input coded data 
and produces a decoded image. The decoded image is input to the motion compensating section 906. The outputting 
25 section 909 outputs the input coded data to recording and transmitting media or the like. 

[0155] The operation of the filter parameter calculating section 903 will be described in detail with reference to Figs. 
1 5, 1 6, and 1 7. In Embodiments 5 to 9, in order to simplify the description, each block is assumed to have a size of 2 x 
2 pixels. 

[0156] First, with respect to the input image, an average value of pixel values in the unit of block is calculated. Drf- 

30 ferences between pixels in the block and the above-mentioned average value are calculated, and difference signals are 
produced. A sum of absolute values of the difference signals is calculated, and the sum is set as the first activity. Next, 
with respect to the first difference image, a sum of absolute values of pixel values in the unit of block is calculated, and 
the sum is set as the second activity. In the embodiment, a sum of absolute values of pixels is used as the activity. Alter- 
natively, variance of pixels in a block, the magnitude of a sum of absolute values of Hadamard transformed AC compo- 

35 nents, or the tike may be used as the activity. 

[0157] From the first activity and the second activity, visual importance tB which is a parameter indicating visual 
importance in the block is calculated by using a table of visual importance shown in Fig. 15. tB is expressed by one of 
continuous values of 0 to 1 . As the value is closer to 0, visual importance is tower, or the value indicates that the region 
is not visually important. By contrast, as the value is closer to 1 , visual importance is higher, or the value indicates that 

40 the region is visually important. 

[0158] For example, an arbitrary block b will be considered. When the first activity of the block b is 2,000 and the 
second activity is 1 ,000, tB of the block b is 0.7 from the table of Fig. 15. This table is an example, and the thresholds 
of the activities and the value of tB may be changed. In the above example, when the first activity of the block b is 2,000 
and the second activity is 1 ,000, tB is 0.7. This value may be set to be 0.6. 

45 [0159] Thereafter, a filter parameter tP which is a parameter for controlling the degree of filtering in the unit of pixel 
is calculated from the visual importance tB. The calculation is performed by the following method. As shown in Fig. 16, 
tP of a pixel in a block is set to be tB of the block In Fig. 16, 1200 to 1208 denote blocks, and 1210 to 121 8 denote visual 
importance tB of the blocks. Each visual importance is placed at the center of the block to which the importance 
belongs. The values of the visual importance are as follows: 1210 has 0.7; 1211 has 0.5; 1212 has 0.5; 1213 has 0.7; 

so 1214 has 0.7; 1215 has 0.5; 1216 has 0.5; 1217 has 0.5; and 1218 has 0.5. 

[0160] The block 1204 will be considered. Fitter parameters 1220 to 1223 of four pixels in the block 1204 have the 
same value as the visual importance of the block 1204. In other words, the values of the filter parameters 1220 to 1223 
of the pixels in the block 1204 are as follows: 1220 has 0.7; 1221 has 0.7; 1222 has 0.7; and 1223 has 0.7. Thereafter, 
from the fitter parameter tP, the filter coefficient of a filter which is to be used for processing the pixel is determined by 

55 using a fitter coefficient table shown in Fig. 1 7. When tP is 0.7, a filter coefficient is selected to be 3. 

[0161] As described above, visual importance of the input image is calculated from the input image and the differ- 
ence image, and a filter process is performed on a region of low visual importance, thereby reducing the information 
amount As a result, a larger code amount can be allocated to a region of higher visual importance, and improvement 
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of the image quality can be realized. 

[0162] In Embodiment 5 described above, visual importance is calculated by using the first activity and the second 
activity. Alternatively, visual importance may be calculated by using the orientation and/or the size of the motion vector 
of a noted block, or the noted block and blocks (for example, adjacent eight blocks) adjacent to the block. 

5 [0163] Specifically, visual importance can be calculated by detecting the manner of changes of the orientations 
and/or the sizes of the motion vectors of a noted block and blocks adjacent to the block. For example, calculation of vis- 
ual importance based on changes of motion vectors will be described with reference to Fig. 22. In the case where tem- 
poral and spatial correlations of images are high, motion vectors of a noted block and blocks in the periphery of the 
block are arranged as shown in Fig. 22(a). By contrast, in the case where temporal and spatial correlations are low, 

io such as the case of water splash or white noises, motion vectors are arranged as shown in Fig. 22(b). In the case of 
Fig. 22(a), visual importance is high. By contrast, in the case of Fig. 22(b), visual importance is low. 

(Embodiment 6) 

75 [0164] Hereinafter, Embodiment 6 of the invention will be described with reference to Figs. 14, 15, and 16. 

[0165] In Fig. 14, 1001 denotes an inputting section, 1002 denotes a motion vector detecting section, 1003 denotes 
a fitter parameter calculating section, 1004 denotes a filter calculating section, 1005 denotes a weight calculating sec- 
tion, 1006 denotes a motion compensating section, 1007 denotes a coding section, 1008 denotes a local decoder, and 
1009 denotes an outputting section. 

20 [0166] Next, the operation of the embodiment will be described. 

[0167] An image signal which is input from the inputting section 1001 is input to the motion vector detecting section 
1002, the filter parameter calculating section 1003, the filter calculating section 1004, and the weight calculating section 
1 005. Irrespective of the picture type of the input image, the motion vector detecting section 1 002 performs motion vec- 
tor detection on the input image with respect to a reference image stored in a memory, and outputs a motion vector and 

25 a first difference image. The motion vector is input to the motion compensating section 1006, and the first difference 
image is input to the filter parameter calculating section 1003. 

[0168] The filter parameter calculating section 1003 calculates a first activity in the unit of block from the input 
image, and a second activity in the unit of block from the first difference image. From the first activity and the second 
activity, thereafter, visual importance which indicates the degree of visual importance in the unit of block with respect to 
30 the input image is calculated. From the visual importance, a filter parameter which is a parameter indicating the degree 
of filtering in the unit of pixel on the input image is calculated. The filter parameter is input to the weight calculating sec- 
tion 1005. 

[0169] The filter calculating section 1004 performs a filter calculation on the input image with a specific filter coeffi- 
cient, and outputs a first filter image. The first filter image is input to the weight calculating section 1005. The weight 

35 calculating section 1 005 performs a weighting calculation based on the filter parameter on the first filter image, and out- 
puts a second filter image. The second filter image is input to the motion compensating section 1 006. When the picture 
type of the input filter image is a P-picture or a B-picture, the motion compensating section 1006 produces a predictive 
image from the input motion vector and the reference image stored in the memory, calculates the difference between 
the predictive image and the filter image, and outputs a second difference image. The second difference image is input 

40 to the coding section 1007. When the picture type of the input filter image is an I -picture, the filter image is deemed as 
a second difference signal, and input to the coding section 1007. 

[0170] The coding section 1007 codes the input second difference image, and outputs a coded data. The coded 
data is input to the local decoder 1008 and the outputting section 1009. The local decoder 1008 decodes the input 
coded data and produces a decoded image. The decoded image is input to the motion compensating section 1006. The 

45 outputting section 1009 outputs the input coded data to recording and transmitting media or the like. 

[0171] The operation of the filter parameter calculating section 1003 will be described in detail with reference to 
Figs. 1 5 and 1 6. First, with respect to the input image, an average value of pixel values in the unit of block is calculated. 
Differences between pixels in the block and the above-mentioned average value are calculated, and difference signals 
are produced. A sum of absolute values of the difference signal values is calculated, and the sum is set as the first activ- 

so ity. Next, with respect to the first difference image, a sum of absolute values of pixel values in the unit of block is calcu- 
lated, and the sum is set as the second activity. A sum of absolute values of pixel values is used as the activity. 
Alternatively, in the same manner as Embodiment 5, variance of pixels in a block or the like may be used as the activity. 
From the first activity and the second activity, tB of the block is calculated by using the table of visual importance shown 
in Fig. 15. 

55 [0172] For example, an arbitrary block b will be considered. When the first activity of the block b is 2,000 and the 
second activity is 1,000, tB of the block b is 0.7 from the table of Fig. 15. Thereafter, a filter parameter tP which is a 
parameter for controlling the degree of filtering in the unit of pixel is calculated from the visual importance tB. The cal- 
culation is performed by the following method. As shown in Fig. 16, tP of a pixel in a block is set to be tB of the block. 
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[0173] When tB in a certain block is 0.7, for example, tP is 0.7 in all of four pixels in the block. This tP is used as a 
weighting coefficient in a weighting calculation. Specifically, a weighting calculation in an arbitrary pixel p is performed 
as indicated by the following (Ex 1). 



5 Value of the pixel pin the second filter image 

= (tP x value of the pixel p in the input image) + ((1 • tP) x value of the pixel p in the first fitter image) 

[0174] As described above, visual importance of the input image is calculated from the input image and the differ- 
to ence image, and a filter process is conducted on a region of lower visual importance, to reduce the information amount, 
whereby a larger code amount can be allocated to a region of higher visual importance, and the image quality can be 
improved. 



75 



(Embodiment 7) 



[0175] Hereinafter, Embodiment 7 of the invention will be described with reference to Figs. 13,15, and 1 6. The con- 
figuration is identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. The filter coefficient 
determining section 904 in the embodiment calculates a filter coefficient from the filter parameter tP. 
[0176] The embodiment and Embodiment 5 are different in the method of determining the fitter coefficient. In 

20 Embodiment 5, a fitter coefficient for each pixel is selected from plural filter coefficient candidates which are previously 
set, on the basis of the fitter parameter. By contrast, in the embodiment, a filter coefficient is calculated from the filter 
parameter. According to this configuration, it is possible to use a filter having more suitable filter properties. 
[0177] As described above, visual importance of the input image is calculated from the input image and the differ- 
ence image, and a fitter process is conducted on a region of lower visual importance, to reduce the information amount, 

25 whereby a larger code amount can be allocated to a region of higher visual importance, and the image quality can be 
improved. 

(Embodiment 8) 

30 [0178] Hereinafter, Embodiment 8 of the invention will be described with reference to Figs. 13,15, and 1 8. The con- 
figuration is identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. The operation of the 
fitter parameter calculating section 903 in the embodiment will be described with reference to Figs. 15 and 18. 
[0179] The filter parameter calculating section 903 calculates tB from the first activity calculated from the input 
image and the second activity calculated from the first difference image, by using the visual importance table shown in 

35 Fig. 15. For example, an arbitrary block b will be considered. When the first activity of the block b is 2,000 and the sec- 
ond activity is 1 ,000, tB of the block b is 0.7 from the table of Fig. 15. 

[0180] Thereafter, as shown in Fig. 18, curved surface interpolation is performed by using tB to calculate tP. 
[0181] tn Fig. 18, 1400 to 1408 denote blocks, and 1410 to 1418 denote block visual importance tB of each block. 
The values of the visual importance of the blocks are respectively as follows: 1410 has 0.7; 141 1 has 0.5; 1412 has 0.5; 
40 1413 has 0.7; 1414 has 0.7; 1415 has 0.5; 1416 has 0.5; 1417 has 0.5; and 1418 has 0.5. Furthermore, 1420 denotes 
a pixel in the block 1404, and 1430 denotes tP of the pixel 1420. 

[0182] When the pixel 1420 will be considered, 1430 which is tP of the pixel 1420 is calculated by curved surface 
interpolation indicated by (Ex. 2) by using four tBs: 1414 which is tB of the block 1404, 1415 which is tB of the block 
1405, 1417 which is tB of the block 1407, and 1418 which is tB of the block 1408. 

45 

tP of the pixel 1420 = (0.75 x (0.75 x tB of the block 1404 + 0.25 x tB of the block 1405)) 

+ (0.25 x (0.75 x tB of the block 1407 + 0.25 x tB of the block 1408)) * 

50 [0183] Substituting tB of the block 1404 = 0.7, tB of the block 1405 = 0.5. tB of the block 1407 = 0.5, and tB of the 
block 1408 = 0.5 into (Ex. 2), tP of the pixel 1 420 is 0.6125. From the filter parameter tP, thereafter, the filter coefficient 
of the fitter which is used for processing the pixel is determined by using the fitter coefficient table shown in Fig. 17. 
When tP is 0.6125, for example, a filter coefficient is selected to be 3. 

[0184] As described above, visual importance of the input image is calculated from the input image and the differ- 
55 ence image, and a fitter process is performed on a region of low visual importance, thereby reducing the information 
amount. As a result, a larger code amount can be allocated to a region of higher visual importance, and improvement 
of the image quality can be realized. A filter parameter in the unit of pixel is calculated by curved surface interpolation 
using visual importance which is calculated in the unit of block. Therefore, the continuity in a block interface can be 
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maintained, and a visual improvement can be realized. 
(Embodiment 9) 

5 [0185] Hereinafter, Embodiment 9 of the invention will be described with reference to Figs. 13, 15. and 19. The con- 
figuration is identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. The operation of the 
filter parameter calculating section 903 in the embodiment will be described with reference to Figs. 15 and 19. 
[0186] The filter parameter calculating section 903 calculates tB from the first activity calculated from the input 
image and the second activity calculated from the first difference image, by using the visual importance table shown in 

io Fig. 15. For example, an arbitrary block b will be considered. When the first activity of the block b is 2,000 and the sec- 
ond activity is 1,000, tB of the block b is 0.7 from the table of Fig. 15. 

[0187] Thereafter, as shown in Fig. 1 9, curved surface interpolation is performed by using tB to calculate tP. At this 
time, tB is placed in one of four corners of the block. In Fig. 19, 1500 to 1508 denote blocks, and 1510 to 1518 denote 
visual importance tB of each block. The values of the visual importance of the blocks are respectively as follows: 1510 
75 has 0.7; 1511 has 0.5; 1512 has 0.5; 1513 has 0.7; 1514 has 0.7; 1515 has 0.5; 1516 has 0.5; 1517 has 0.5; and 1518 
has 0.5. Furthermore, 1520 denotes a pixel in the block 1504, and 1530 denotes tP of the pixel 1520. 
[0188] When the pixel 1520 will be considered, 1530 which is tP of the pixel 1520 is calculated by curved surface 
interpolation indicated by (Ex. 3) by using four tBs: 1514 which is tB of the block 1504, 1515 which is tB of the block 
1505, 1517 which is tB of the block 1507, and 1518 which is tB of the block 1508. 

20 

tP of the pixel 1520 = (0.5 x (0.5 x tB of the block 1 504 + 0.5 x tB of the block 1 505)) 

+ (0.5 x (0.5 x tB of the block 1507 + 0.5 xtB of the block 1508)) [ " J 

25 [0189] Substituting tB of the block 1504 = 0.7, tB of the block 1505 = 0.5, tB of the block 1507 = 0.5, and tB of the 
block 1508 = 0.5 into (Ex. 3), tP of the pixel 1520 is 0.55. Thereafter, the filter coefficient of the filter which is used for 
processing the pixel is determined by using the filter coefficient table shown in Fig. 17. When tP is 0.55, for example, a 
fitter coefficient is selected to be 3. 

[0190] As described above, visual importance of the input image is calculated from the input image and the differ- 
so ence image, and a filter process is performed on a region of lower visual importance, thereby reducing the information 
amount. As a result, a larger code amount can be allocated to a region of higher visual importance, and improvement 
of the image quality can be realized. In curved surface interpolation using visual importance which is calculated in the 
unit of block, the visual importance is placed in one of four corners of a block, whereby the calculation accuracy of the 
interpolation calculation can be reduced as compared with the case where visual importance is placed at the center of 
35 a block Therefore, a reduction of circuits in the calculation section can be realized. Furthermore, the continuity in a 
block interface can be maintained by curved surface interpolation, and a visual improvement can be realized. 

(Embodiment 10) 

40 [0191] Hereinafter, Embodiment 10 of the invention will be described with reference to Figs. 1 3, 1 5, 20 and 21 . The 
configuration is identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. The operation of 
the filter parameter calculating section 903 in the embodiment will be described with reference to Figs. 15, 20 and 21 . 
The embodiment will be described with assuming that each block has a size of 4 x 4 pixels. 

[0192] The filter parameter calculating section 903 calculates tB from the first activity calculated from the input 
45 image and the second activity calculated from the first difference image, by using the visual importance table shown in 
Fig. 15. 

[0193] Thereafter, edge detection is performed on each of the blocks. If it is judged that there is an edge, tB is 
placed in the edge interface. Fig. 20 shows the placement of tB in the case where there is an edge in a block. In Rg. 
20, 1600 denotes a block containing an edge region 1601, and 1602 denotes tB which is calculated with respect to the 

so block 1600. As shown in Rg. 20, tB 1602 is placed in the edge interface. The edge detection is performed in the proce- 
dure shown in Fig. 21. In Fig. 21(a), 1700 denotes a block consisting of 4 x 4 pixels, and designations of 100 and 100 
indicate pixel values of pixels. Accordingly, in the block 1700, there are fourteen pixels of a pixel value of 100, and two 
pixels of a pixel value of 100. Edge detections in the horizontal and vertical directions are independently performed on 
the block 1700. First, with respect to the horizontal direction, a position where the absolute value of the difference 

55 between adjacent pixels exceeds a specific threshold value =100 and is the largest is regarded as the horizontal edge 
interface. Results are shown in Fig. 21 (b). In Fig. 21 (b), 1 703 denotes the horizontal edge interface. With respect to the 
vertical direction, thereafter, in the same manner as the horizontal direction, a position where the absolute value of the 
difference between adjacent pixels exceeds a threshold value = 100 and is the largest is regarded as the vertical edge 



24 



EP 1 033 883 A1 



interface. Results are shown in Fig. 21(c). tn Fig. 21(c), 1704 denotes the vertical edge interface. The edge interface of 
the block 1700 is detected from the horizontal edge interface and the vertical edge interface. Results are shown in Fig. 
21(d). In Ftg. 21(d), 1705 denotes the edge interface of the block 1700, and tB 1602 of the Mock 1700 is placed on the 
edge interface 1705. 

5 [0194] As described above, visual importance of the input image is calculated from the input image and the differ- 
ence image, and a fitter process is performed on a region of low er visual importance, thereby reducing the information 
amount As a result, a larger code amount can be allocated to a region of higher visual importance, and improvement 
of the image quality can be realized. In curved surface interpolation using visual importance, the visual importance is 
placed in an interlace of an edge in a block, whereby the edge can be preserved, and an improvement of the image 

10 quality can be realized. Furthermore, the continuity in a block interface can be maintained by curved surface interpola- 
tion, and a visual improvement can be realized. 

(Embodiment 11) 

is [0195] Hereinafter, Embodiment 1 1 of the invention will be described with reference to Fig. 13. The configuration is 
identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. In the embodiment, irrespective 
of the picture type of the input image, the motion vector detecting section 902 performs the same motion vector detec- 
tion to produce the first difference image. At this time, the motion vector outputs a motion vector corresponding to the 
picture type. 

20 [0196] The embodiment and Embodiment 5 are different from each other in the method of calculating the first dif- 
ference image. In Embodiment 5, when the first difference image is to be calculated, forward prediction is performed on 
an I- or P-picture, and bidirectional prediction is performed on a B-picture, or the motion detection is performed in 
accordance with each picture type. By contrast, in the embodiment, the same motion detection is performed to produce 
the first difference image, irrespective of the picture type of the input image. As described above, irrespective of the pic- 

25 ture correspondence of the input image, the same motion vector detection is performed to produce the first difference 
image, whereby visual importance can be detected at a higher accuracy, and an improvement of the image quality of a 
reproduced image can be realized. 

(Embodiment 12) 

30 

[0197] Hereinafter, Embodiment 12 of the invention will be described with reference to Fig. 13. The configuration is 
identical with that of Fig. 13, and the operation is identical with that of Embodiment 5. In the embodiment, irrespective 
of the picture type of the input image, the motion vector detecting section 902 performs motion vector detection in the 
unit of block on the input image with respect to a reference image stored in a memory, and outputs a motion vector and 

35 a first difference image. Moreover, an activity in the original image state is compared with that in the difference image, 
it is determined which one of irrtraframe coding or irrterframe coding is to be performed on the block, and block type 
information indicative of information of the coding method is output. The motion vector is input to the motion compen- 
sating section 906. The block type information is input to the filter parameter calculating section 903 and the motion 
compensating section 906. The first difference image is input to the filter parameter calculating section 903. 

40 [0198] The filter parameter calculating section 903 calculates a first activity in the unit of blockfrom the input image, 
and a second activity in the unit of block from the first difference image. From the first activity and the second activity, 
and the block type information, thereafter, visual importance which indicates the degree of visual importance in the unit 
of blockwith respect to the input image is calculated. For a block in which intraframe coding is selected, for example, its 
visual importance is set to be 1 . Further, from the visual importance, a filter parameter which is a parameter for corrtrol- 

45 ling the degree of filtering in the unit of pixel with respect to the input image is calculated. The filter parameter is input 
to the filter coefficient determining section 904. 

[0199] The filter coefficient determining section 904 determines a filter coefficient from the input filter parameter. 
The filter coefficient is input to the filter calculating section 905. The fitter calculating section 905 performs a fitter calcu- 
lation on the input image by using the input filter coefficient, to produce a fitter image. The filter image is input to the 

so motion compensating section 906. When the picture type of the input filter image is a P-picture or a B-picture, the 
motion compensating section 906 produces a predictive image from the input motion vector, the reference image stored 
in the memory, and the block type information, calculates the difference between the predictive image and the filter 
image, and outputs a second difference image. The second difference image is input to the coding section 907. When 
the picture type of the input filter image is an l-picture, the fitter image is deemed as a second difference signal, and 

55 input to the coding section 907. The coding section 907 codes the input second difference image, and outputs a coded 
data. The coded data is input to the local decoder 908 and the outputting section 909. 

[0200] As described above, visual importance of the input image is calculated from the input image and the differ- 
ence image, and a filter process is performed on a region of lower visual importance, thereby reducing the information 
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amount As a result, a larger code amount can be allocated to a region of higher visual importance, and improvement 
of the image quality can be realized. 

[0201 ] The means constituting the video signal coding apparatus of each of above-described Embodiments 5 to 1 2 
may be configured as hardware, or may be replaced with software having the same functions as corresponding ones of 
5 the above-mentioned hardware. 

Industrial Applicability 

[0202] As apparent from the above description, the invention can provide a video signal coding method which 
w codes a bit stream before transformation so that the code amount of the transformed bit stream can be set within a pre- 
determined code amount, and also an apparatus for the same. 

Claims 

15 1. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, 
quantization, and variable length coding, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables N kinds (N £ 2) of code 
amounts to be equal to or smaller than a predetermined code amount, the code amounts being obtained by 
20 applying N kinds of variable length codings on the discrete cosine transformed input digital video signal. 

2. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
25 duce a transformed signal; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be 
equal to or smaller than a predetermined code amount, the code amounts being obtained by applying quanti- 
zation and N kinds of variable length codings on the transformed signal; 

quantizing means for quantizing the transformed signal to produce a quantized signal, by using said quantizer 
30 which is selected by said quantization estimating means; and 

variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

3. A video signal coding apparatus according to claim 2, characterized in that the input digital video signal is a video 
35 signal which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

4. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, 
40 quantization, and first variable length coding, to produce a first bit stream that can be transformed to a second bit 

stream by using decoding of the first variable length coding, difference predictive coding, and second variable 
length coding, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
45 that are obtained by applying the first and second variable length codings on AC components of the discrete 

cosine transformed input digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a maximum DC code amount which is a larger 
one among a predictive code amount which is obtained by performing difference predictive coding on DC com- 
ponents of the discrete cosine transformed input digital video signal, and a fixed code amount in the case 
so where the DC components are set to a fixed length. 

5. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, dif- 
ference predictive coding, quantization, and first variable length coding, to produce a first bit stream that can be 
transformed to a second bit stream by using decoding of the first variable length coding, decoding of the difference 

55 predictive coding, and second variable length coding, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
that are obtained by applying the first and second variable length codings on AC components of the discrete 
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cosine transformed input digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a maximum DC code amount which is a larger 
one among a predictive code amount which is obtained by performing difference predictive coding on DC com- 
ponents of the discrete cosine transformed input digital video signal, and a fixed code amount in the case 
where the DC components are set to a fixed length. 

A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

code amount estimating means for setting a larger one among a difference predictive code amount which is 
obtained by performing difference predictive coding on DC components of the discrete cosine transformed 
input digital video signal, and a fixed code amount in the case where the DC components are set to a fixed 
length, as a DC estimated code amount; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be 
equal to or smaller than a differential code amount which is obtained by subtracting the DC estimated code 
amount from a predetermined code amount, the code amounts being obtained by applying quantization and N 
kinds of variable length codings on AC components of the transformed signal; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, 
by using said quantizer which is selected by said quantization estimating means; and 
variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

predictive differential coding means for performing predictive differential coding on DC components of the dis- 
crete cosine transformed input digital video signal, and setting a code amount produced in the predictive differ- 
ential coding, as a difference predictive code amount; 

code amount estimating means for setting a larger one among the difference predictive code amount, and a 
fixed code amount in the case where the DC components are set to a fixed length, as a DC estimated code 
amount; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be 
equal to or smaller than a differential code amount which is obtained by subtracting the DC estimated code 
amount from a predetermined code amount, the code amounts being obtained by applying quantization and N 
kinds of variable length codings on AC components of the transformed signal; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, 
by using said quantizer which is selected by said quantization estimating means; and 
variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

A video signal coding apparatus characterized in that said apparatus comprises: 

code amount estimating means for, for each of predetermined blocks of an input digital video signal, obtaining 
an average value of pixels in the block, setting the average value as a value of DC components which are 
obtained by performing discrete cosine transform on the digital video signal, and setting a larger one among a 
difference predictive code amount which is obtained by performing difference predictive coding on the DC com- 
ponents, and a fixed code amount in the case where the DC components are set to a fixed length, as a DC 
estimated code amount; 

orthogonal transforming means for performing discrete cosine transform on the digital video signal for each of 
the blocks to produce a transform coding unit; 

quantization estimating means for selecting a quantizer which enables N kinds (N £ 2) of code amounts to be 
equal to or smaller than a differential code amount which is obtained by subtracting the DC estimated code 
amount from a predetermined code amount, the code amounts being obtained by applying quantization and N 
kinds of variable length codings on AC components of the transformed signal; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, 
by using said quantizer which is selected by said quantization estimating means; and 
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variable length coding manes for applying one of the N kinds of variable length codings which are used in said 
quantization estimating means, on the quantized signal. 

9. A video signal coding apparatus according to any one of claims 6 to 8, characterized in that the input digital video 
signal is a video signal which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

10. A video signal coding apparatus according to claim 9, characterized in that the difference predictive code amount 
of the DC components is a difference between a predetermined code amount, and an average value of pixels of a 
block in the coding unit within the DC estimated code amount. 

11. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, 
quantization, and first variable length coding, and first additional information is added to produce a first bit stream 
that can be transformed to a second bit stream by using decoding of the first variable length coding, and second 
variable length coding, and adding second additional information, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
that are obtained by applying the first and second variable length codings on AC components of the discrete 
cosine transformed digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a maximum additional information amount which 
is a larger one among information amounts of the first and second additional information. 

12. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

additional information estimating means for detecting a maximum additional information amount which is a 
larger one among a code amount of first additional information that is to be attached to a first bit stream which 
is obtained by applying first variable length coding on the transformed signal, and a code amount of second 
additional information that is to be attached to a second bit stream which is obtained by applying second vari- 
able length coding on the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on the transformed signal, and a code amount that is 
obtained by applying quantization and the second variable length coding on the transformed signal, to be equal 
to or smaller than a differential code amount that is obtained by subtracting the maximum additional information 
amount from a predetermined code amount; 

quantizing means for quantizing the transformed signal to produce a quantized signal, by using said quantizer 
which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

1 3. A video signal coding apparatus according to claim 12, characterized in that the input digital video signal is a video 
signal which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

14. A video signal coding apparatus according to claim 13, characterized in that the differential code amount is a dif- 
ference between an average additional information amount which is obtained by dividing the maximum additional 
information amount by a number of the coding units in the input digital video signal, and the predetermined code 
amount. 

15. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, 
quantization, and first variable length coding, and first additional information is added to produce a first bit stream 
that can be transformed to a second bit stream by using decoding of the first variable length coding, and second 
variable length coding, and adding the first additional information with changing to second additional information, 
characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
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that are obtained by applying the first and second variable length codings on AC components of the discrete 
cosine transformed digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a maximum additional information amount which 
is a larger one of information amounts of the first and second additional information, and a maximum DC code 
amount which is a larger one of a predictive code amount which is obtained by performing difference predictive 
coding on DC components of the discrete cosine transformed input digital video signal, and a fixed code 
amount in the case where the DC components are set to a fixed length. 

1 6. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, dif- 
ference predictive coding, quantization, and first variable length coding, and first additional information is added to 
produce a first bit stream that can be transformed to a second bit stream by using decoding of the first variable 
length coding, decoding of the difference predictive coding, and second variable length coding, and adding the first 
additional information with changing to second additional information, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
that are obtained by applying the first and second variable length codings on AC components of the discrete 
cosine transformed digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a maximum additional information amount which 
is a larger one of information amounts of the first and second additional information, and a maximum DC code 
amount which is a larger one among a predictive code amount which is obtained by performing difference pre- 
dictive coding on DC components of the discrete cosine transformed input digital video signal, and a fixed code 
amount in the case where the DC components are set to a fixed length. 

17. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

code amount estimating means for setting a larger one of a difference predictive code amount which is 
obtained by performing difference predictive coding on DC components of the discrete cosine transformed 
input digital video signal, and a fixed code amount in the case where the DC components are set to a fixed 
length, as a DC estimated code amount; 

additional information estimating means for detecting a maximum additional information amount which is a 
larger one among a code amount of first additional information that is to be attached to a first bit stream which 
is obtained by applying first variable length coding on the transformed signal, and a code amount of second 
additional information that is to be attached to a second bit stream which is obtained by applying second vari- 
able length coding on the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a 
code amount that is obtained by applying quantization and the second variable length coding on the AC com- 
ponents of the transformed signal, to be equal to or smaller than a differential code amount that is obtained by 
subtracting the DC estimated code amount and the maximum additional information amount from a predeter- 
mined code amount; 

quantizing means for quantizing AC components of the transformed signal to produce a quantized signal, by 
using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

18. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

predictive coding means for performing difference predictive coding on DC components of the discrete cosine 
transformed input digital video signal, and obtaining a difference predictive code amount; 
code amount estimating means for setting a larger one of the difference predictive code amount, and a fixed 
code amount in the case where the DC components are set to a fixed length, as a DC estimated code amount; 
additional information estimating means for detecting a maximum additional information amount which is a 
larger one of a code amount of first additional information that is to be attached to a first bit stream which is 
obtained by applying first variable length coding on the transformed signal, and a code amount of second addi- 
tional information that is to be attached to a second bit stream which is obtained by applying second variable 
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length coding on the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a 
code amount that is obtained by applying quantization and the second variable length coding on the AC com- 
ponents of the transformed signal, to be equal to or smaller than a differential code amount that is obtained by 
subtracting DC estimated code amount and the maximum additional information amount from a predetermined 
code amount; 

quantizing means for quantizing AC components of the transformed signal to produce a quantized signal, by 

using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

19. A video signal coding apparatus characterized in that said apparatus comprises: 

code amount estimating means for, for each of predetermined blocks of an input digital video signal, obtaining 
an average value of pixels in the block, setting the average value as a value of DC components which are 
obtained by performing discrete cosine transform on the digital video signal, and setting a larger one of a dif- 
ference predictive code amount which is obtained by performing difference predictive coding on the DC com- 
ponents, and a fixed code amount in the case where the DC components are set to a fixed length, as a DC 
estimated code amount; 

orthogonal transforming means for performing discrete cosine transform on the digital video signal for each of 
the blocks to produce a transform coding unit; 

additional information estimating means for detecting a maximum additional information amount which is a 
larger one among a code amount of first additional information that is to be attached to a first bit stream which 
is obtained by applying first variable length coding on the transform coding unit, and a code amount of second 
additional information that is to be attached to a second bit stream which is obtained by applying second vari- 
able length coding on the transform coding unit; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transform coding unit, and 
a code amount that is obtained by applying quantization and the second variable length coding on the AC com- 
ponents of the transform coding unit, to be equal to or smaller than a differential code amount that is obtained 
by subtracting the DC estimated code amount and the maximum additional information amount from a prede- 
termined code amount; 

quantizing means for quantizing the AC components of the transform coding unit to produce a quantized sig- 
nal, by using said quantizer which is selected by said quantization estimating means; and 
variable length coding manes for applying the first or second variable length coding on the quantized signal. 

20. A video signal coding apparatus according to any one of claims 1 7 to 1 9, characterized in that the input digital video 
signal is a video signal which is previously divided into predetermined coding units, and 

said quantization estimating means selects a quantizer for each of the coding units. 

21 . A video signal coding apparatus according to claim 20, characterized in that the difference predictive code amount 
of the DC components is a difference obtained by subtracting, from the predetermined code amount, the DC esti- 
mated code amount for a block in the coding units, and an average additional information amount which is obtained 
by dividing the maximum additional information amount by a number of the coding units in the input digital video 
signal. 

22. A video signal coding method in which an input digital video signal is coded by a first system that uses discrete 
cosine transform, quantization, and first variable length coding, to produce a first bit stream that can be transformed 
to a second bit stream which is coded by a second system by using decoding of the first variable length coding, 
difference predictive coding, and second variable length coding, characterized in that 

when a quantizer for the quantization is to be selected, 

a second system code amount in the case where the difference predictive coding and the second variable 
length coding are performed on a digital video signal which is discrete cosine transformed and quantized pre- 
viously in time to a discrete cosine transformed input digital video signal which is the object of the quantization 
is compared with a preset ideal code amount at the second system, and 

when the second system code amount is equal to or smaller than the ideal code amount, a quantizer which 
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performs coding at a first target code amount that is previously determined in the first system is selected, and 
when the second system code amount is larger than the ideal code amount, a quantizer which performs coding 
at a code amount that is smaller than the f irst target code amount is selected. 

A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, dif- 
ference predictive coding, quantization, and first variable length coding to produce a first bit stream that can be 
transformed to a second bit stream by using decoding of the first variable length coding, decoding of the difference 
predictive coding, and second variable length coding, characterized in that 

when a quantizer for the quantization is to be selected, 

a second system code amount in the case where the difference predictive coding and the second variable 
length coding are performed on a digital video signal which is discrete cosine transformed, difference predictive 
coded, and quantized previously in time to a discrete cosine transformed input digital video signal which is the 
object of the quantization 

is compared with a preset ideal code amount of the second system, and 

when the second system code amount is equal to or smaller than the ideal code amount, a quantizer which 
performs coding at a first target code amount that is previously determined in the first system is selected, and 
when the second system code amount is larger than the ideal code amount, a quantizer which performs coding 
at a code amount that is smaller than the first target code amount is selected. 

A video signal coding method according to claim 22 or 23, characterized in that the ideal code amount is stepwise 
increased by a substantially constant value with the passage of time. 

A video signal coding method according to any one of claims 22 to 24, characterized in that, when the second sys- 
tem code amount is larger than the ideal code amount, a quantizer which performs coding at a code amount that 
is obtained by subtracting a difference between the second system code amount and the ideal code amount from 
the first target code amount is selected. 

A video signal coding method according to any one of claims 22 to 25, characterized in that the digital video signal 
which is discrete cosine transformed, and quantized previously in time means a predetermined partial signal which 
is previous to the discrete cosine transformed input digital video signal which is the object of the quantization. 

A video signal coding apparatus in which an input digital video signal is coded by a first system that uses discrete 
cosine transform, quantization, and first variable length coding, to produce a first bit stream that can be transformed 
to a second bit stream which is coded by a second system by using decoding of the first variable length coding, 
difference predictive coding, and second variable length coding, characterized in that 

said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on the input digital video signal to pro- 
40 duce a transformed signal; 

quantizing means for quantizing the transformed signal to produce a quantized signal; 
DC component code amount estimating means for estimating a difference predictive code amount in the case 
where the difference predictive coding is performed on DC components of a digital video signal which is dis- 
crete cosine transformed and quantized previously in time to the transformed signal which is the object of the 
45 quantization in said quantizing means; 

second-system code amount estimating means for estimating a second system code amount which is a total 
of the difference predictive code amount, and a code amount in the case where the second variable length cod- 
ing is performed on AC components of the digital video signal which is discrete cosine transformed and quan- 
tized previously in time; quantization estimating means for comparing the second system code amount with a 
so preset ideal code amount of the second system, and. when the second system code amount is equal to or 

smaller than the ideal code amount, selecting a quantizer which performs coding at a first target code amount 
that is previously determined in the first system, and, when the second system code amount is larger than the 
ideal code amount, selecting a quantizer which performs coding at a code amount that is smaller than the first 
target code amount; and 

55 variable length coding means for applying the first variable length coding on the quantized signal, and wherein 

said quantizing means quantizes AC components of the transformed signal which is an object of the quantiza- 
tion, by using said quantizer which is selected by said quantization estimating means, thereby producing the 
quantized signal. 
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28. A video signal coding apparatus in which an input digital video signal is coded by using discrete cosine transform, 
difference predictive coding, quantization, and first variable length coding to produce a first bit stream that can be 
transformed to a second bit stream by using decoding of the first variable length coding, decoding of the difference 
predictive coding, and second variable length coding, characterized in that 

5 

said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on the input digital video signal to pro- 
duce a transformed signal; 

quantizing means for quantizing the transformed signal to produce a quantized signal; 
10 DC component code amount estimating means for estimating a DC code amount in the case where the differ- 

ence predictive coding is performed on DC components of a digital video signal which is discrete cosine trans- 
formed, difference predictive coded, and quantized previously in time to the transformed signal which is the 
object of the quantization in said quantizing means; 

second-system code amount estimating means for estimating a second system code amount which is a total 
75 of the DC code amount, and a code amount in the case where the second variable length coding is performed 

on AC components of the digital video signal which is discrete cosine transformed, difference predictive coded, 
and quantized previously in time; 

quantization estimating means for comparing the second system code amount with a preset ideal code amount 
of the second system, and, when the second system code amount is equal to or smaller than the ideal code 

20 amount, selecting a quantizer which performs coding at a first target code amount that is previously determined 

in the first system, and, when the second system code amount is larger than the ideal code amount, selecting 
a quantizer which performs coding at a code amount that is smaller than the first target code amount; and 
variable length coding means for applying the first variable length coding on the quantized signal, and wherein 
said quantizing means quantizes AC components of the transformed signal which is an object of the quantiza- 

25 tion, by using said quantizer which is selected by said quantization estimating means, thereby producing the 

quantized signal. 

29. A video signal coding apparatus according to claim 27 or 28, characterized in that the ideal code amount is step- 
wise increased by a substantially constant value with the passage of time. 

30 

30. A video signal coding apparatus according to any one of claims 27 to 29, characterized in that, when the second 
system code amount is larger than the ideal code amount, said quantization estimating means selects a quantizer 
which performs coding at a code amount that is obtained by subtracting a difference between the second system 
code amount and the ideal code amount from the first target code amount. 

35 

31 . A video signal coding apparatus according to any one of claims 27 to 30, characterized in that the digital video sig- 
nal which is discrete cosine transformed and quantized previously in time means a predetermined partial signal 
which is previous to the discrete cosine transformed input digital video signal which is the object of the quantization. 

40 32. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, 
quantization, and first variable length coding, and first additional information is added to produce a first bit stream 
that can be transformed to a second bit stream by using decoding of the first variable length coding, difference pre- 
dictive coding, and second variable length coding, and adding the first additional information with changing to sec- 
ond additional information, characterized in that 

45 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
that are obtained by applying the first and second variable length codings on AC components of the discrete 
cosine transformed digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a larger one among a first total in which a fixed 
so code amount in the case where DC components of the discrete cosine transformed input digital video signal 

are set to a fixed length is added to an information amount of the first additional information, and a second total 
in which a difference predictive code amount which is obtained by performing difference predictive coding on 
DC components of the discrete cosine transformed input digital video signal is added to an information amount 
of the second additional information. 

55 

33. A video signal coding method in which an input digital video signal is coded by using discrete cosine transform, dif- 
ference predictive coding, quantization, and first variable length coding, and first additional information is added to 
produce a first bit stream that can be transformed to a second bit stream by using decoding of the first variable 
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length coding, decoding of the difference predictive coding, and second variable length coding, and adding the first 
additional information with changing to second additional information, characterized in that 

in the quantization, quantization is performed while selecting a quantizer which enables both code amounts 
that are obtained by applying the first and second variable length codings on AC components of the discrete 
cosine transformed digital video signal, to be equal to or smaller than a differential code amount that is 
obtained by subtracting, from a predetermined code amount, a larger one among a first total in which a differ- 
ence predictive code amount which is obtained by performing difference predictive coding on DC components 
of the discrete cosine transformed input digital video signal is added to an information amount of the first addi- 
tional information, and a second total in which a fixed code amount in the case where DC components of the 
discrete cosine transformed input digital video signal are set to a fixed length is added to an information 
amount of the second additional information. 

34. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

first detecting means for detecting a first total amount of a fixed code amount in the case where DC compo- 
nents of the transformed signal are set to a fixed length, and a code amount of first additional information that 
is to be attached to a first bit stream which is obtained by applying first variable length coding on the trans- 
formed signal; 

second detecting means for detecting a second total amount of a difference predictive code amount which is 
obtained by performing difference predictive coding on the DC components of the transformed signal, and a 
code amount of second additional information that is to be attached to a second bit stream which is obtained 
by applying second variable length coding on the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a 
code amount that is obtained by applying quantization and the second variable length coding on the AC com- 
ponents of the transformed signal, to be equal to or smaller than a differential code amount that is obtained by 
subtracting a larger one among the first total amount and the second total amount from a predetermined code 
amount; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, 

by using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 

35. A video signal coding apparatus characterized in that said apparatus comprises: 

orthogonal transforming means for performing discrete cosine transform on an input digital video signal to pro- 
duce a transformed signal; 

predictive coding means for performing difference predictive coding on DC components of the discrete cosine 
transformed input digital video signal, and obtaining a difference predictive code amount; 
first detecting means for detecting a first total amount of the difference predictive code amount, and a code 
amount of first additional information that is to be attached to a first bit stream which is obtained by applying 
first variable length coding on the transformed signal; 

second detecting means for detecting a second total amount of a fixed code amount in the case where DC 
components of the transformed signal are set to a fixed length, and a code amount of second additional infor- 
mation that is to be attached to a second bit stream which is obtained by applying second variable length cod- 
ing on the transformed signal; 

quantization estimating means for selecting a quantizer which enables both a code amount that is obtained by 
applying quantization and the first variable length coding on AC components of the transformed signal, and a 
code amount that is obtained by applying quantization and the second variable length coding on the AC com- 
ponents of the transformed signal, to be equal to or smaller than a differential code amount that is obtained by 
subtracting a larger one among the first total amount and the second total amount from a predetermined code 
amount; 

quantizing means for quantizing the AC components of the transformed signal to produce a quantized signal, 

by using said quantizer which is selected by said quantization estimating means; and 

variable length coding manes for applying the first or second variable length coding on the quantized signal. 
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36. A video signal coding apparatus characterized in that said apparatus comprises: 

motion vector detecting means for, for an input image, detecting a motion vector with respect to a predeter- 
mined reference image; 

5 difference image producing means for, for the input image, producing a first difference image with respect to 

the reference image; 

fitter coefficient determining means for calculating visual importance of the input image on the basis of the input 
image and the first difference image, and determining a filter coefficient for performing a filter process on the 
input image; 

10 filter processing means for performing a filter process on the input image by using the filter coefficient, to pro- 

duce a filter image; 

motion compensating means for performing motion compensation on the filter image by using the motion vec- 
tor, to produce a second difference image; and 

coding means for performing coding on the second difference image to produce a coded data. 

15 

37. A video signal coding apparatus according to claim 36, characterized in that said fitter coefficient determining 
means calculates visual importance of the input image on the basis of an activity of the input image and an activity 
of the first difference image, and determines the filter coefficient. 

20 38. A video signal coding apparatus according to claim 36 or 37, characterized in that said filter coefficient determining 
means selects the filter coefficient for performing the filter process, from a plurality of fitter coefficient candidates. 

39. A video signal coding apparatus characterized in that said apparatus comprises: 

25 motion vector detecting means for, for an input image, detecting a motion vector with respect to a predeter- 

mined reference image; 

difference image producing means for, for the input image, producing a first difference image with respect to 
the reference image; 

first filter processing means for performing a first filter process on the input image to produce a first filter image; 
30 filter parameter determining means for calculating visual importance of the input image on the basis of the 

input image and the first difference image, and determining a filter parameter for performing a second filter 
process on the input image and the first filter image; 

second filter processing means for performing a second filter process on the input image and the first filter 
image by using the filter parameter, to produce a second filter image; 
35 motion compensating means for performing motion compensation on the second filter image by using the 

motion vector, to produce a second difference image; and 

coding means for performing coding on the second difference image to produce a coded data. 

40. A video signal coding apparatus according to claim 39, characterized in that said filter parameter determining 
40 means calculates the visual importance on the basis of an activity of the input image and an activity of the first dif- 
ference image, and determines the filter parameter. 

41 . A video signal coding apparatus according to claim 39 or 40, characterized in that said filter parameter determining 
means selects the filter parameter for performing the second filter process, from a plurality of filter parameter can- 

45 didates. 

42. A video signal coding apparatus according to any one of claims 36 to 41 , characterized in that the filter coefficient 
or the filter parameter is a coefficient in the predetermined unit of block. 

so 43. A video signal coding apparatus according to any one of claims 36 to 41 , characterized in that the filter coefficient 
or the filter parameter is a coefficient in the unit of pixel. 

44. A video signal coding apparatus according to any one of claims 36 to 43, characterized in that said filter coefficient 
determining means or said fitter parameter determining means determines the filter coefficient or the filter param- 

55 eter by curved surface approximation using the visual importance. 

45. A video signal coding apparatus according to any one of claims 36 to 43, characterized in that said filter coefficient 
determining means or said filter parameter determining means places the visual importance at one of four corners 
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in a block constituting the input image, and determines the filter coefficient or the filter parameter while. 

46. A video signal coding apparatus according to any one of claims 36 to 43, characterized in that said filter coefficient 
determining means or said fitter parameter determining means performs edge detection on a block constituting the 
input image, and, when an edge exists, places the visual importance in an edge interface, and determines the filter 
coefficient or the filter parameter. 

47. A video signal coding apparatus according to any one of claims 36 to 46, characterized in that said motion vector 
detecting means performs same motion vector detection on the input image to produce a difference image, and a 
motion vector corresponding to a picture type of the input image. 

48. A video signal coding apparatus according to any one of claims 36 to 46, characterized in that said motion vector 
detecting means performs motion vector detection on the input image by bidirectional interframe prediction to pro- 
duce a difference image, and a motion vector corresponding to a picture type of the input image. 

49. A video signal coding apparatus characterized in that said apparatus comprises: 

difference image producing means for performing motion vector detection in the unit of block on an input 
image, to produce its motion vector, block type information indicative of information of the block coding, and a 
first difference image; 

filter parameter calculating means for calculating visual importance in a block in the unit of block, from the input 
image, the block type information, and the first difference image, and calculating a filter parameter for control- 
ling a degree of filtering in the unit of pixel, from the visual importance; 

filter coefficient determining means for determining a filter coefficient from a plurality of filter coefficient candi- 
dates, based on the filter parameter; 

filter calculating means for performing a filter calculation on the input image by using the filter coefficient to pro- 
duce a filter image; 

motion compensating means for performing motion compensation on the filter image by using the motion vec- 
tor and the block type information, to produce a second difference image; and 
coding means for performing coding on the second difference image to produce a coded data. 

50. A program recording medium characterized in that a program for realizing all or a part of means of the video signal 
coding apparatus according to any one of claims 2 to 3, 6 to 10, 12 to 14, 17 to 21, 27 to 31, and 34 to 49 by a 
computer is stored in said medium. 
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Fig. 19 
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